Speaking system for mute using hand gesture

Project Title

Speaking system for mute using hand gesture

Project Area of Specialization Wearables and ImplantableProject Summary

The name of proposed project is “Speaking system for mute people using hand gestures". There are around 9 million mute persons in the globe. Communication for mute people is a major issue, and there is a significant communication gap between voluble and mute people. They utilise sign language which is a kind of nonverbal communication so it is difficult for them to communicate with ordinary people. To address this problem, a smart speaking system is introduced that allows mute people to interact with voluble people through hand motions and gestures. The project's goal is to create a speaking system for mute people that uses hand gestures to establish communication between mute and voluble persons. Hand gestures which can represent ideas using unique shapes and finger orientation and will be displayed and heard through speaker.

Project Objectives

• The aim of the project is to design a speaking system for mute people with hand gestures for establishing communication between mute and normal people.

• To develop this project which is consisting of flex sensor and raspberry pi which takes pre defined input and produces voice message as the output through the speaker.
• To accomplish structure in which glove will record all the gestures made by user and then translate these gestures into visual forms as well as in audio form.
• To achieve the communication of mute people like a normal people.

Project Implementation Method

• The system reads a person's hand motions for different variations of hand movement. It consists of a Raspberry Pi controller board, LCD display, speaker, flex sensor, and accelerometer. as shown in the figure.

•  It has a trigger sensor to ensure the system does not speak when the person is just involuntarily making hand motions.

•  The raspberry pi processor constantly receives input sensor values and processes them. Once the message is found in the memory for the set of sensor values, the message is retrieved and is spoken out using the text of speech processing through the speaker.
• 

Benefits of the Project

Aftercompletion of this project, the mute people get help to communicate with voluble people. It can help mute people to communicate with everybody (known and Stranger) more effectively.

The language gets converted into text and will be displayed on the digital display screen.

In this project work, sign language will be more helpful for the ease of communication between the mute people and voluble people. 

Its a simple wearable device, that can be easily carryout by mute people everywhere. 

Technical Details of Final Deliverable

The project's goal is to create a mute-to-normal communication system that includes hand gestures,
by creating a setup with a flex sensor and a Raspberry Pi that receives a predetermined input and outputs a speech message through the speaker using the proposed algorithm.
 The system accomplishes a structure in which the glove records all of the user's gestures and then converts them into visual and audio formats.

 It enables mute people to communicate as if they were normal.

Sign language will be more useful in this project for facilitating communication between silent people and normal people.

Final Deliverable of the Project Hardware SystemCore Industry MedicalOther Industries Medical Core Technology Wearables and ImplantablesOther Technologies OthersSustainable Development Goals Good Health and Well-Being for PeopleRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	28530
Raspberry Pi 3	Equipment	1	9000	9000
Acclerometer	Equipment	2	500	1000
Flex Sensors	Equipment	2	3500	7000
Glove	Equipment	1	850	850
Resistors, Capacitors, Diodes, Transistors	Equipment	12	50	600
IC , IC sockets	Equipment	2	350	700
Transformer/ Adapter	Equipment	2	400	800
LED, Switch	Equipment	3	60	180
printing material	Miscellaneous	1	7000	7000
Cables and Connectors	Equipment	12	50	600
PCB and Breadboard	Equipment	2	200	400
PCB and Breadboard	Equipment	2	200	400