Interpreting device for Disable(Dumb) people.

Project Title

Interpreting device for Disable(Dumb) people.

Project Area of Specialization Electrical/Electronic EngineeringProject Summary

Sign language to Voice interpreting device:

Sign language comprises the movement of fingers, wrist, and arm.  Any person can communicate in sign language by learning signs. For compatibility and ease of access, standard signs are designed and used worldwide. In sign language, most of the signs only need finger movements.
In this project, we note them and try to digitize maximum signs by using flex sensors. A flex sensor is a device that converts an analog signal into digital form. It is a variable resistor whose resistance changes with the bend angle. 
With a voltage divider circuit, we can calculate the variable voltage output. After that, we can store it in our microcontroller circuit. We record the intensities in such away that we can monitor the maximum and minimum variation in resistances to observe the specified sign more discreetly. This range will increase the performance of the system. 
Next, we move towards processing side, where we use different coding techniques to match the values coming from the input side with the stored data values. We have to design the "Lookup Table" approach. It is an approach in which we feed the values into the database. Later on, we compare these values with the existing values. Each signal has its symbol. This symbol will go towards the Speakjet IC, which is also a part of the processing side. It stores the voice signal, when it receives the specific symbol, it generates that voice signal using an amplifier and a speaker. Here our output part is also covered by using the amplifier and the speaker.
After completing this part, we also want to implement it using the android phone in place of Speakjet IC. We design an android app, which will receive the symbol from the microcontroller by using Bluetooth or a Wi-Fi module. After receiving that symbol, it will produce the human being's voice. This audio file is already present in the android phone. The app will only match that symbol with its database and load the corresponding audio file.

Project Objectives

Objectives:

• Learn the different signs of sign language for our system.
• Gather the information about the components we need in the project.
• Make a system that can store these signs in a digital form.
• Make our system able to learn and stores these signs.
• Process the new symbol with the previously stored character information for recognition.
• Identification of each character with a specific sign.
• Use an audio storing and generating device to produce a voice signal.
•  In parallel, use a Bluetooth module or Wi-Fi module to transmit that symbol to an android device.
• Design the android app, which can receive the symbol coming from the device.
• Load the audio or voice signals in the android device.
• Make that app able to load the corresponding audio file of the received symbol.
• Test this complete project hundreds of times to detect the faults and rectify them accordingly.
• After that, implement this project on a lower level, on a disabled person or so.
• After that, prepare the project report in which includes all the research work and the data which we get during different experiments
• The binding of the documentation in which all the chapters included

Project Implementation Method

We have done our research part after which we have decided to use the following technology to make this project. We are going to implement this idea at a low level. After successful completion, anyone can make it on a larger scale.

First of all, we use flex sensors and stitch them into a glove. We attach make a voltage divider for each flex sensor and provide a 9V across this voltage divider so we can get variable voltage from this voltage divider on the movement of the flex sensor.

Next, we feed these voltages to the analog pins of the Arduino. These analog pins read the voltages from the flex sensors and give the output up to a max of 1023. We make a transfer function and different look-up tables that store different values for these sensors. We use different audio that will be just relevant to our sign language. later, we code our device to play these audio files according to our finger gestures. We use a good quality speaker for that purpose.

In the end, we design an android application that will get the signal and play the audio in the android phone, but this is the last part of our project if the previous part is completed then we will go for it.

We are much confident to complete this project in time. We are also much confident about the technology we are going to use. It will definitely work and give good results.

Benefits of the Project

This project will bring the special people (who cannot speak) up in the society. This will also give them a good status in society by providing them the confidence to convey their thought to normal people easily.

There is a good hidden talent in these people which had not been discovered because of our inability to understand them. This device will allow them to speak like a normal human being. Also, this device will help the aged persons who cannot speak and suffer a lot due to their silence. 

Technical Details of Final Deliverable

After completing this project we have a device that includes a glove that will be used as an input of the system, a processing board like Arduino which can store these signs and the voice signals, and we shall have a speaking device that includes a speaker and speak jet IC kit which produces audio for the signal provided.

In the end, we have a complete rechargeable device which can detect the sign language and produce audio signal accordingly.

Final Deliverable of the Project HW/SW integrated systemCore Industry ITOther Industries Medical , Health , Telecommunication Core Technology OthersOther Technologies Artificial Intelligence(AI), Internet of Things (IoT)Sustainable Development Goals Good Health and Well-Being for PeopleRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	80000
Arduino	Equipment	1	2200	2200
Flex sensors	Equipment	15	2600	39000
Speaker	Equipment	1	400	400
Bluetooth Module	Equipment	1	600	600
Wifi module	Equipment	1	1000	1000
Speak jet IC kit	Equipment	1	4500	4500
Gloves	Equipment	2	500	1000
Micro SD card module	Equipment	1	700	700
Micro SD 4GB	Equipment	1	500	500
ADC 220VAC-12VDC (5W)	Equipment	1	1300	1300
4.2V lithium ion	Equipment	6	250	1500
Capacitpors	Equipment	5	20	100
Inductor	Equipment	8	50	400
transformer	Equipment	1	300	300
Voltage regulator	Equipment	1	500	500
Resistors/ Wires etc	Equipment	1	500	500
Android Studio	Equipment	1	2000	2000
Breadboard	Equipment	3	400	1200
PCB Etching	Equipment	2	600	1200
Solder Iron	Equipment	1	500	500
DMM	Equipment	1	600	600
Travelling	Equipment	1	10000	10000
Printing and Binding	Miscellaneous	1	10000	10000