Hearing impaired Gesture Recognition using Arm band

Our application is especially designed for hearing impaired person and those who cannot talk, such person are not feel comfortable while interacting with the normal person. So, by considering this thing we made an application based solution where a person whom is not able to hear but use PSL (Pakist

Project Title

Hearing impaired Gesture Recognition using Arm band

Project Area of Specialization

Software Engineering

Project Summary

Our application is especially designed for hearing impaired person and those who cannot talk, such person are not feel comfortable while interacting with the normal person. So, by considering this thing we made an application based solution where a person whom is not able to hear but use PSL (Pakistan Sign Language) as a gesture message conveying, our application is able to detect these signs/gestures through myo device using EMG AND IMU sensors by connecting myo device to the application via Bluetooth, our application is able to classify gestures and convert them into text or a voice which is easy to understand by hearing impaired person,  in the same way hearing person is also able to communicate to the hearing impaired person and convey their message easily to the hearing impaired person, normal person message voice/text  is detected by our application and convert it into gestures so the hearing impaired person can easily understand the message In future we will make the application more Authentic and add different sign languages (like Arabic sign language) to transform this project into a product.

Project Objectives

The main concern of this project is ease of communication and finishing the gap between hearing impaired people and normal people and helping them in emergency cases where communication is mandatory

Project Implementation Method

MYO SENSOR BASED APPLICATION FOR PSL GESTURE RECOGNITION:

project implemented by connecting myo armband via application

gesture created by wearing armband recognize throuh machine learning approach through mathematical calcutions applied on EMG AND IMU Signals 

Benefits of the Project

Benifits

1.SIGN LANGUAGE COMMUNICATION B/W HEARING IMPAIRED PERSON AND HEARING PERSON

2.PSL GESTURE DETECTION via application

3.RELIABLE SENSOR MYO ARM BAND CONNECTIVITY

4.GESTURE TO AUDIO MESSAGE CONVERSION

5.EASE TO HANDLE SENSOR

Technical Details of Final Deliverable

FINAL DELIVERABLES:

1.PSL based DUAL MODE APPLICATION for Hearing and Hearing impaired person

2. Sensor (MYO ARM BAND) connectivity via bluetooth

3. For hearing impaired person (MODE 1) SENSOR generates signal and application detect hand gestures pattern through machine learning algorithm on trained dataset model.

4. Detected gesture dispalyed on screen on text box this written message convey to hearing impaired person via voice translator. which is easy to understand by hearing person

5. For hearing person (MODE 2) message capture to application via written text in textbox or by voice detection technique this message check out in database and gesture detected shown to hearing imapired person .

Final Deliverable of the Project

HW/SW integrated system

Core Industry

IT

Other Industries

Education

Core Technology

Artificial Intelligence(AI)

Other Technologies

Others

Sustainable Development Goals

Reduced Inequality

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com