SIGN TO SPEECH

The communication gap between people with ability to speak and those without this ability is very inconvenient and can lead to a multitude of problems. The deaf community uses hand gestures to communicate whereas most people do not understand this language and are unable to communicate or understand

Project Title

SIGN TO SPEECH

Project Area of Specialization

Wearables and Implantable

Project Summary

The communication gap between people with ability to speak and those without this ability is very inconvenient and can lead to a multitude of problems. The deaf community uses hand gestures to communicate whereas most people do not understand this language and are unable to communicate or understand them. Hence through our project, we aim to bridge the communication gap by giving a voice to the deaf community, there regular hand gesture communication will be converted to audible audio so they may convey their views to a broader audience. The project was inspired by the idea of converting signs to spoken language with the help of hand rotation and finger movements. The requirements for this project include a wearable glove that is responsive, portable, feasible, marketable, affordable, and durable.  Five bend sensors are placed on a glove, four for the fingers and one for the thumb. These sensors measure the bending in the fingers and thumb. And another sensor, the Gyroscope sensor, measures the rotation of the hand, to capture the motion and the position of the hands. All data from sensor will be input to an Arduino microcontroller, where we plan on implementing machine learning algorithm which will help in translating the data and then it will transfer the appropriate outcome value to the android app, which translates the text message to a voice message, via Bluetooth device, which produces an audible human hearing voice.

Project Objectives

In the world, there are millions of people who cannot express their thoughts and feelings in speech. Pakistan is no exception, with an estimated 10 million hearing-impaired citizens. There a lack of accessibility for these people in nearly every field amongst them some are markets, job interviews, and day-to-day communication. We, as engineers, propose using our skillset to help improve accessibility by providing an effective method to assist the deaf in delivering their thoughts by providing them a voice. We propose to make a hand gesture sign to audible sound converter using the hand glove to break the communication barrier amongst us as a community.

Project Implementation Method

For implementation of our project, we have to use sensors, that are flex sensors and gyroscope sensor which will collect data from users (silent who can't speak) when they move their hand while communicating (sign language). This data will be received in by a microcontroller, Arduino, and using machine learning algorithm it will decode the sign and then send a signal to the mobile application. The mobile application will be connected to a hand glove via Bluetooth and it will get data and show the message as well as speak that message which user wants to convey. 

Benefits of the Project

We are part of society and we should try to solve problem in our societies. Communication is right of each person in society. There are some people in our society who cannot communicate or participate in many social, political and profession events due to their inability to speak. As the population of our country (and the world) increases, the possibility encounter a deaf individual increases manifolds. Extra attention has to be paid to their integration into society for their collective and society cumulative uplift.  There a lack of accessibility for these people in nearly every field amongst them some are markets, job interviews, and day-to-day communication. We, as engineers, propose using our skillset to help improve accessibility by providing an effective method to assist the deaf in delivering their thoughts by providing them a voice. Through our project we aim to reduce the difficulties faced by the deaf community due to lack of communication. By bridging the communication gap, the life experience of the deaf will be enhanced by allowing them to express themselves and being understood better.

Technical Details of Final Deliverable

We will deliver one hand glove and mobile application. Hand glove will able to translate reasonable sign to speech. It will be flexible, light in weight enough to use it anytime easily. The hand glove will be able to sense the motion of the wrist as well as the fingers and this data will be transmitted to the microcontroller. The controller will be connected to a mobile, in which through an application it will translate vocally what the gesture meant.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

Others

Other Industries

Others

Core Technology

Wearables and Implantables

Other Technologies

Wearables and Implantables

Sustainable Development Goals

Reduced Inequality

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com