Sign Language Translator for Mute and Deaf

Project Title

Sign Language Translator for Mute and Deaf

Project Area of Specialization Electrical/Electronic EngineeringProject Summary

Disability of speech is a disability which affects the ability of a person to communicate through speech and hearing. People who are affected by this use other media of communication such as sign language.

Presents the solution for deaf and dumb people who uses sign language for communication and mostly normal people do not understand there sign language that is why there is a communication gap between dump (mute) / deaf people and normal people.

We aimed to build a device that can help those people which have disability of hearing and speech. Sign Language Translator is a device that can help disabled people like mute (dumb) and deaf to communicate with other and other people can communicate with disabled people by using Speech to text for mute to normal people communication and speech to text to deaf to normal people communication.

The proposed model takes sensors reading from hand glove and send it to Android device (Phone/Tablet) through Bluetooth Android app communicate with glove and reads and analyze data and show output as text and speech in English and Urdu.

Project Objectives

This project aims to lower the barrier in communication between mute communities and others (people without disability). 

Develop an electronic device (Hand Glove) at which flex sensors and gyro sensor are mounted and for displaying result an Android app is designed that can translate sign language into speech for mute to other communication and Speech to text for deap people can read what other person is saying.

Project Implementation Method

This project is based of hand gesturs so that we are using flex sensors and gyro sensors wich are connect to Arduino board all of this hardware are mounted on hand glove we are using a pair of glove they are connect with each other with NRF24 wireless transceiver and sensors reading are transmitted through bluetooth module HC06 to an Android device where an Android app is intalled which is custom build for translating all the sensors data from bluetooth module into text and speech (voice) using TTS Text to Speech. 

Benefits of the Project

• Lower the barrier of communication between Dumb (mute) / Deaf people and ordinary people.
• Low Cost device then hearing aids
• Works offline
• Use Multiple languages Like (English and urdu) for speech.
• Update words in dictionary of Android App.

Technical Details of Final Deliverable

We build our project with in few months after researching. we divided this period into 7 phases.

Phase -1

• Research

Phase -2

• Design

Phase -3

• Prototype

Phase -4

• Hardware design and build into PCB

Phase -5

• Software design and build

Phase -6

• Testing and debugging

Phase -7

• Final Result

Sign language Translator is consist of hardware and software we choose these handware and software for building our project.

Hardware:

1. Arduino Nano                   x2
2. MPU6050                         x2
3. NRF24                              x2
4. HC-06                               x1
5. Battery Charging Module  x2
6. 600mah Lipo Battery         x2
7. PCB board                         x1
8. Flex Sensors 2.2 inch        x10
9. Bc 547 transistor               x1
10. Led                                    x1
11. 10 K ohm resistors             x10
12. 100 K ohm resistors          x4

Software

1. Arduino IDE for programming arduino
2. Android Studio for building android app
3. Adobe Illustrator for app design and logo

Final Deliverable of the Project HW/SW integrated systemCore Industry OthersOther Industries IT , Media Core Technology RoboticsOther Technologies Artificial Intelligence(AI), Wearables and Implantables, OthersSustainable Development Goals Good Health and Well-Being for PeopleRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	31610
Arduino Nano	Equipment	2	600	1200
MPU6050	Equipment	2	500	1000
flex sensors	Equipment	10	2600	26000
HC-06	Equipment	1	600	600
Battery Charging Module	Equipment	2	200	400
NRF24	Equipment	2	250	500
PCB	Miscellaneous	1	60	60
Lipo Battery 600mah	Equipment	2	450	900
Gloves	Miscellaneous	1	500	500
Connection Cable	Miscellaneous	3	150	450