App for Deaf

In this project we are trying to help deaf/hard-of-hearing and mute people. They face different kind of problems when they try to communicate with others. They cannot convey their message to normal people because everyone cannot understand sign language. We are developing a 'mobi

Project Title

App for Deaf

Project Area of Specialization

Artificial Intelligence

Project Summary

In this project we are trying to help deaf/hard-of-hearing and mute people. They face different kind of problems when they try to communicate with others. They cannot convey their message to normal people because everyone cannot understand sign language. We are developing a 'mobile application' and 'Hand-gesture recogntion gloves' through which the deaf and mute people can easily communicate to others. 

Project Objectives

The main objective of this project is to ease the hardship of communication to deaf and mute persons. Everyone does not understand sign language and there must be a way for persons who talk in signs; to convey their message. We are making a Mobile application in which a person signs in front of camera and the mobile application gets the video frame as input and recognize the gesture and convert it into text and voice. We are also making a Hand glove gesture recognizer that can detect hand/finger movements to recognize the gesture. 

Project Implementation Method

In Hand gloves, we are using flex sensors and accelerometer with arduino. As the flex sensor bends, it changes the voltage and with the help of accelerometer we are taking the x,y,z axis of hand in space, giving theses as input to a trained-classifier (in python)that can classify between different gestures.

In Mobile Application, we are using are a classifier that is trained on python and converting it into tensorflow lite model to use it in mobile devices. The model then gets each frame from the preview of mobile camera and predicts the output.

Benefits of the Project

• Deaf and Mute persons can talk to others by doing ASL gestures.
• Help them to get education in normal institutes.
• Facilitates teacher to teach the deaf and mute persons without any difficulties. 
• It increases the opportunities of jobs for deaf people by using this application.
• They can contribute in different fields just like a normal person by using this application. 

Technical Details of Final Deliverable

--

Final Deliverable of the Project

HW/SW integrated system

Core Industry

IT

Other Industries

Education

Core Technology

Artificial Intelligence(AI)

Other Technologies

Internet of Things (IoT)

Sustainable Development Goals

Reduced Inequality

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com