StoS MODULO
Our goal is to eradicate the issue that people face difficulty while understanding the signs of dumb and deaf people so this system will help people to communicate with other normal people. Our project will detect actions and then recognize the signs after that it will tell through text and speech,
2025-06-28 16:29:39 - Adil Khan
StoS MODULO
Project Area of Specialization Artificial IntelligenceProject SummaryOur goal is to eradicate the issue that people face difficulty while understanding the signs of dumb and deaf people so this system will help people to communicate with other normal people. Our project will detect actions and then recognize the signs after that it will tell through text and speech, what deaf or mute person is trying to say. This can be very helpful for blind, deaf and dumb people in communicating with others as knowing sign language is not something that is common to everyone, moreover, this can be extended to creating automatic editors, where the person can easily write just by their hand gestures and understand either through text or speech. This project will help hospital and other care units to work with deaf and disabled people.
Project ObjectivesThe core idea behind our project is to facilitate blind, deaf, dumb people and the people around them who are unable to understand through gestures/ signs with the idea of digital communication.
Our motivation is to facilitate blind, Deaf and Mute people who use hand gesture sign language to communicate, hence normal people face problems in recognizing their language by signs made. Which is why there is a need for a system that recognize the different signs and conveys the information to normal people through text or sound system.
Project Implementation MethodWe are planning to use OpenCV, deep learning, tensor flow, Numpy array and action recognition models of Artificial Intelligence.
Firstly, we extract the keypoints using holistic module. Then we store the data in their respective folders and make directories of videos.
We will then build and train LSTM Neural Network by using all our stored data and make probable predictions. We will then convert those detections into sentences of those words.
Benefits of the ProjectWe plan to eradicate the communication gap between the blind and deaf to hearing people. Not everyone can understand the sign language so we are going to evaluate those signs and make words and sentences out of those through AI. Then normal human being can type what they are saying and AI will bring signs of those words, So the cycle of communication can be completed.
Technical Details of Final DeliverableFinal deliverable include a system through which two way real time communication can be fulfilled between deaf and hearing person either through webapp or mobile application. Deaf will do the sign language and system will convert it to words.Similarly normal person can type and system will show sign to deaf and mute.
Final Deliverable of the Project HW/SW integrated systemCore Industry MedicalOther Industries Health Core Technology Artificial Intelligence(AI)Other Technologies RoboticsSustainable Development Goals Good Health and Well-Being for People, Industry, Innovation and InfrastructureRequired Resources| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 79750 | |||
| Arduino | Equipment | 5 | 1000 | 5000 |
| Power Supply | Equipment | 1 | 2000 | 2000 |
| Circuit boards | Equipment | 5 | 50 | 250 |
| NUC Mini computer | Equipment | 1 | 50000 | 50000 |
| AI based Camera | Equipment | 2 | 6000 | 12000 |
| Gesture Generating Equpment | Equipment | 1 | 500 | 500 |
| Overheads | Miscellaneous | 1 | 3000 | 3000 |
| Final report Printing | Miscellaneous | 1 | 5000 | 5000 |
| Poster printing | Miscellaneous | 1 | 2000 | 2000 |