Gesture to speech for deaf and dumb patients.

Project Title

Gesture to speech for deaf and dumb patients.

Project Area of Specialization Electrical/Electronic EngineeringProject Summary

In this project we represent smart glove for and dumb patient. About four billion people in the world are dumb. The blind people can talk freely by means of normal language whereas the dumb have their own manual-visual language known as sign language. Sign language is a non-verbal form of intercourse which is found amongst dumb communities in world. The languages do not have a common origin and hence difficult to interpret. The project aims to facilitate people by means of a Glove based communication interpreter system. The glove is internally equipped with five flex sensors. For each specific gesture, the flex sensor produces a proportional change in resistance. The processing of these hand gestures is in microcontroller and the LABVIEW software. It compares the input signal with predefined voltage levels stored in memory. According to that required sound is produced which is stored is memory with the help of speaker . In such a way it is easy for dumb to communicate with normal people. The main aim of the project is to reduce the communication gap between dumb community and normal people. This system is proposed to improve lifestyle of deaf and dumb people. This is also favorable for degrading the communication difference between the blind person and the dumb person. All over the paper is effective and efficient because it is using LABVIEW.

Project Objectives

This is a project for “Human Welfare”. This will bring a drastic change for the dumb people. There communication will become easy after this innovation.
Sign language has helped the hearing-impaired communicate for many centuries, way before it was formalized and officially recognized, but this long-standing language of gestures has now been given a 201st-century technological upgrade.

Project Implementation Method

The Figure 1 shows the basic circuit diagram of flex sensor. Using flex Sensor we measure the change in resistance Motion Sensors (Flex Sensor) - The flex sensors are the sensors that change in resistance depending upon the amount of bend on the sensor [4]. They convert the change in bend to electrical resistance. They can be unidirectional and bidirectional. Available in thin strip form. The Flex Sensor patented technology is based on resistive carbon elements. As a variable printed resistor, the Flex Sensor achieves great form-factor on a thin flexible substrate. When the substrate is bent, the sensor produces a resistance output correlated to the bend radius the smaller the radius, the higher the resistance value. Flex sensors has the length from 1 inch to 5 Inch, i.e., near about 73mm in length and 6.35mm in width. The resistance of the flex sensor varies above or below 550?. The main difference between unidirectional flex sensor and bidirectional flex sensor is that, as the unidirectional flex sensor is bent, the resistance increases, while when a bidirectional flex sensor is bent, the resistance decreases. At rest or 00 bend, the resistance of the unidirectional flex sensor is 10K?.As it is further bent at 450, the resistance increases according to the bent. At 900 bent, the resistances of the unidirectional flex sensor ranges from 30K? to 50K?.When we apply a power to Microcontroller board microcontroller initialize and continuously read the data from the flex sensor then it will display the text and corresponding audio output 
When the user as to give an input from the flex sensor then it will send the data to rf receiver and light and fan will be on and off.
Text and audio MSG
It’s time to take my pills 
Can u get me today’s newspaper?
I’m starving! Can I have my meal?
Get me some water to drink!
I need a pertinent attire.
I feel sickish, call the doctor!
Its critical, need expeditious help.
 I need to go the restroom!

Benefits of the Project

This paper is a useful tool for speech impaired and partially paralyzed patients which fill the communication gap between patients, doctors and relatives.
 1. As it is portable, cost effective.
2. Requires low power operating on a single lithium-ion rechargeable battery and having less weight and robust gives patient liberty to carry it anywhere at their will.
3. This paper will give dumb a voice to speak for their needs and to express their gestures
4. Hence this paper is an attempt to make it easy to understand the actions of the dumb people by getting the output in the form of text and voice. 

Technical Details of Final Deliverable

The circuit will contains the following major components

ATmega32A Microcontroller 

ATTiny2313

5 Flex sensors 

16*2 LCD 

APR33A3 Voice Recorder & Playback

 HT12E

 HT12D

434MHz RF Transmitter & Receiver 

MOC3021 BT136 

3.7V LiPo Battery 

DC-DC Converter 

Final Deliverable of the Project HW/SW integrated systemCore Industry MedicalOther Industries Education , Media , Health Core Technology Internet of Things (IoT)Other Technologies Robotics, Wearables and ImplantablesSustainable Development Goals Good Health and Well-Being for People, Reduced Inequality, Life on LandRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	40530
Microcontroller atmega32a	Equipment	4	1000	4000
16x2 lcds	Equipment	2	400	800
Resistors and capacitors	Equipment	30	100	3000
Buzzers	Equipment	5	200	1000
Leds and flex sensors	Equipment	10	300	3000
Dip switches and buttons	Equipment	10	93	930
Lithium batteries and speakers	Equipment	4	500	2000
Voice recorder and playback	Equipment	2	2000	4000
Rf transmitter and recievers	Equipment	4	1000	4000
Encoder and decorder	Equipment	4	700	2800
Others	Equipment	1	5000	5000
Visits and papers and posters and software activation	Miscellaneous	5	2000	10000