Our goal is to eradicate the issue that people face difficulty while understanding the signs of dumb and deaf people so this system will help people to communicate with other normal people. Our project will detect actions and then recognize the signs after that it will tell through text and speech,
StoS MODULO
Our goal is to eradicate the issue that people face difficulty while understanding the signs of dumb and deaf people so this system will help people to communicate with other normal people. Our project will detect actions and then recognize the signs after that it will tell through text and speech, what deaf or mute person is trying to say. This can be very helpful for blind, deaf and dumb people in communicating with others as knowing sign language is not something that is common to everyone, moreover, this can be extended to creating automatic editors, where the person can easily write just by their hand gestures and understand either through text or speech. This project will help hospital and other care units to work with deaf and disabled people.
The core idea behind our project is to facilitate blind, deaf, dumb people and the people around them who are unable to understand through gestures/ signs with the idea of digital communication.
Our motivation is to facilitate blind, Deaf and Mute people who use hand gesture sign language to communicate, hence normal people face problems in recognizing their language by signs made. Which is why there is a need for a system that recognize the different signs and conveys the information to normal people through text or sound system.
We are planning to use OpenCV, deep learning, tensor flow, Numpy array and action recognition models of Artificial Intelligence.
Firstly, we extract the keypoints using holistic module. Then we store the data in their respective folders and make directories of videos.
We will then build and train LSTM Neural Network by using all our stored data and make probable predictions. We will then convert those detections into sentences of those words.
We plan to eradicate the communication gap between the blind and deaf to hearing people. Not everyone can understand the sign language so we are going to evaluate those signs and make words and sentences out of those through AI. Then normal human being can type what they are saying and AI will bring signs of those words, So the cycle of communication can be completed.
Final deliverable include a system through which two way real time communication can be fulfilled between deaf and hearing person either through webapp or mobile application. Deaf will do the sign language and system will convert it to words.Similarly normal person can type and system will show sign to deaf and mute.
| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Arduino | Equipment | 5 | 1000 | 5000 |
| Power Supply | Equipment | 1 | 2000 | 2000 |
| Circuit boards | Equipment | 5 | 50 | 250 |
| NUC Mini computer | Equipment | 1 | 50000 | 50000 |
| AI based Camera | Equipment | 2 | 6000 | 12000 |
| Gesture Generating Equpment | Equipment | 1 | 500 | 500 |
| Overheads | Miscellaneous | 1 | 3000 | 3000 |
| Final report Printing | Miscellaneous | 1 | 5000 | 5000 |
| Poster printing | Miscellaneous | 1 | 2000 | 2000 |
| Total in (Rs) | 79750 |
This project, titled as, ?A Non-Invasive Attendance System Based on Face Identification (N...
The title of the project is ?School Management System?. This project will handle whole act...
Plastics are lightweight and durable materials, which can readily be molded into a variety...
The aim of this project is to build a toy vehicle or a small car, avoiding obstacles and f...
Recently, all over the world, natural disaster made many destructions and took many v...