App for Deaf
In this project we are trying to help deaf/hard-of-hearing and mute people. They face different kind of problems when they try to communicate with others. They cannot convey their message to normal people because everyone cannot understand sign language. We are developing a 'mobi
2025-06-28 16:30:16 - Adil Khan
App for Deaf
Project Area of Specialization Artificial IntelligenceProject SummaryIn this project we are trying to help deaf/hard-of-hearing and mute people. They face different kind of problems when they try to communicate with others. They cannot convey their message to normal people because everyone cannot understand sign language. We are developing a 'mobile application' and 'Hand-gesture recogntion gloves' through which the deaf and mute people can easily communicate to others.
Project ObjectivesThe main objective of this project is to ease the hardship of communication to deaf and mute persons. Everyone does not understand sign language and there must be a way for persons who talk in signs; to convey their message. We are making a Mobile application in which a person signs in front of camera and the mobile application gets the video frame as input and recognize the gesture and convert it into text and voice. We are also making a Hand glove gesture recognizer that can detect hand/finger movements to recognize the gesture.
Project Implementation MethodIn Hand gloves, we are using flex sensors and accelerometer with arduino. As the flex sensor bends, it changes the voltage and with the help of accelerometer we are taking the x,y,z axis of hand in space, giving theses as input to a trained-classifier (in python)that can classify between different gestures.
In Mobile Application, we are using are a classifier that is trained on python and converting it into tensorflow lite model to use it in mobile devices. The model then gets each frame from the preview of mobile camera and predicts the output.
Benefits of the Project- Deaf and Mute persons can talk to others by doing ASL gestures.
- Help them to get education in normal institutes.
- Facilitates teacher to teach the deaf and mute persons without any difficulties.
- It increases the opportunities of jobs for deaf people by using this application.
- They can contribute in different fields just like a normal person by using this application.
--
Final Deliverable of the Project HW/SW integrated systemCore Industry ITOther Industries Education Core Technology Artificial Intelligence(AI)Other Technologies Internet of Things (IoT)Sustainable Development Goals Reduced InequalityRequired Resources| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 16250 | |||
| Flex Sensors | Equipment | 5 | 3000 | 15000 |
| Accelerometer | Equipment | 1 | 480 | 480 |
| Arduino Uno | Equipment | 1 | 700 | 700 |
| wires and resistors | Miscellaneous | 1 | 70 | 70 |