Interpreting device for Disable(Dumb) people.

Sign language to Voice interpreting device: Sign language comprises the movement of fingers, wrist, and arm.  Any person can communicate in sign language by learning signs. For compatibility and ease of access, standard signs are designed and used worldwide. In sign lang

Project Title

Interpreting device for Disable(Dumb) people.

Project Area of Specialization

Electrical/Electronic Engineering

Project Summary

Sign language to Voice interpreting device:

Sign language comprises the movement of fingers, wrist, and arm.  Any person can communicate in sign language by learning signs. For compatibility and ease of access, standard signs are designed and used worldwide. In sign language, most of the signs only need finger movements.
In this project, we note them and try to digitize maximum signs by using flex sensors. A flex sensor is a device that converts an analog signal into digital form. It is a variable resistor whose resistance changes with the bend angle. 
With a voltage divider circuit, we can calculate the variable voltage output. After that, we can store it in our microcontroller circuit. We record the intensities in such away that we can monitor the maximum and minimum variation in resistances to observe the specified sign more discreetly. This range will increase the performance of the system. 
Next, we move towards processing side, where we use different coding techniques to match the values coming from the input side with the stored data values. We have to design the "Lookup Table" approach. It is an approach in which we feed the values into the database. Later on, we compare these values with the existing values. Each signal has its symbol. This symbol will go towards the Speakjet IC, which is also a part of the processing side. It stores the voice signal, when it receives the specific symbol, it generates that voice signal using an amplifier and a speaker. Here our output part is also covered by using the amplifier and the speaker.
After completing this part, we also want to implement it using the android phone in place of Speakjet IC. We design an android app, which will receive the symbol from the microcontroller by using Bluetooth or a Wi-Fi module. After receiving that symbol, it will produce the human being's voice. This audio file is already present in the android phone. The app will only match that symbol with its database and load the corresponding audio file.

Project Objectives

Objectives:

• Learn the different signs of sign language for our system.
• Gather the information about the components we need in the project.
• Make a system that can store these signs in a digital form.
• Make our system able to learn and stores these signs.
• Process the new symbol with the previously stored character information for recognition.
• Identification of each character with a specific sign.
• Use an audio storing and generating device to produce a voice signal.
•  In parallel, use a Bluetooth module or Wi-Fi module to transmit that symbol to an android device.
• Design the android app, which can receive the symbol coming from the device.
• Load the audio or voice signals in the android device.
• Make that app able to load the corresponding audio file of the received symbol.
• Test this complete project hundreds of times to detect the faults and rectify them accordingly.
• After that, implement this project on a lower level, on a disabled person or so.
• After that, prepare the project report in which includes all the research work and the data which we get during different experiments
• The binding of the documentation in which all the chapters included

Project Implementation Method

We have done our research part after which we have decided to use the following technology to make this project. We are going to implement this idea at a low level. After successful completion, anyone can make it on a larger scale.

First of all, we use flex sensors and stitch them into a glove. We attach make a voltage divider for each flex sensor and provide a 9V across this voltage divider so we can get variable voltage from this voltage divider on the movement of the flex sensor.

Next, we feed these voltages to the analog pins of the Arduino. These analog pins read the voltages from the flex sensors and give the output up to a max of 1023. We make a transfer function and different look-up tables that store different values for these sensors. We use different audio that will be just relevant to our sign language. later, we code our device to play these audio files according to our finger gestures. We use a good quality speaker for that purpose.

In the end, we design an android application that will get the signal and play the audio in the android phone, but this is the last part of our project if the previous part is completed then we will go for it.

We are much confident to complete this project in time. We are also much confident about the technology we are going to use. It will definitely work and give good results.

Benefits of the Project

This project will bring the special people (who cannot speak) up in the society. This will also give them a good status in society by providing them the confidence to convey their thought to normal people easily.

There is a good hidden talent in these people which had not been discovered because of our inability to understand them. This device will allow them to speak like a normal human being. Also, this device will help the aged persons who cannot speak and suffer a lot due to their silence. 

Technical Details of Final Deliverable

After completing this project we have a device that includes a glove that will be used as an input of the system, a processing board like Arduino which can store these signs and the voice signals, and we shall have a speaking device that includes a speaker and speak jet IC kit which produces audio for the signal provided.

In the end, we have a complete rechargeable device which can detect the sign language and produce audio signal accordingly.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

IT

Other Industries

Medical , Health , Telecommunication

Core Technology

Others

Other Technologies

Artificial Intelligence(AI), Internet of Things (IoT)

Sustainable Development Goals

Good Health and Well-Being for People

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com