Smart Gloves for converting sign to speech

Project Title

Smart Gloves for converting sign to speech

Project Area of Specialization Biomedical EngineeringProject Summary

About 9 billion people around the globe are deaf-mute which is an effective percentage of the world's population. This population only communicate with each others using motion of their hand and expressions. As the name indicates in this project, we use different sensors for detection of motion and it's conversion to text and speech. According to dump people, for every movement they make, there exists a unique meaning for that. That message is kept in a database. 

Project Objectives

1- The basic objective of our project is to develop a portable device for the people who suffer from speech impairment, providing them an aid to communicate easily.

2- The project aims to lower the communication gap between the mute community and additionally the standard world. The projected methodology interprets language into speech.

3- The project is meant to be a prototype to check the feasibility of recognizing sign language using sensor gloves.

4- Sign language are not easy to recognize as they are difficult to understand and also highly complex to learn. The day to day functioning of people with disabilities can be developed and improved by use of products based on assistive technology. 

Project Implementation Method

This project uses controller to control all the processes and data gloves includes Force Sensitive Resistors(FSR) ad flex sensors along with accelerometer /gyroscope sensor will track the movement of fingers as well as the entire palm. The system combines these signals from all sensors to generate a digital code, which corresponds with a particular letter. To differentiate between similar gestures, the glove is also equipped with an accelerometer. Codes into a string of written letters, and sends them via Bluetooth to be displayed on a Smartphone. The coded data from Arduino is given to android mobile by using Bluetooth module. The database will be created for different alphabets of American Sign Language in the android phone. When the input data matches with the data in the database then we will get the required output and translate the gesture into corresponding speech. A LCD will be used corresponding text. This project will be further developed to recognize words. 

Benefits of the Project

* Usable for physically challenged people.

* Communication between mute people and normal people.

* Medical application.

* For educational purpose.

* Gesture control of remote devices.

* Conveying information related operations.

* In public place for announcements. 

Technical Details of Final Deliverable

Materials and Methods:

1- Data Glove

Data glove consists of flex sensors. Flex sensors (also called bend sensors) are flexible sensor which support gestures of the hand which is sensed by the dete or.

2- Flex Sensors

A flex sensor or a bend sensor is a sensor that measures the amount of reflection or bending. It is a variable resistor like no others. It's terminal resistance changes when it is bending. It does not have polarized terminals like diode. So there are no positive and negative terminals. 

3- Accelerometer and gyroscope

In this project we have to use some equipment for sensing rotation of hand and fingers. There are two sensors for this purpose i.e gyroscope and accelerometer. We compared both of their functionality and then implement using one of them. The main difference between the two devices is simple: one can sense rotation, whereas other cannot. In comparison, the accelerometer measures linear acceleration based on vibration. Moreover gyroscopes are more expensive so we preferred using Accelerometer.

4- FSR Sensor

A force-sensitive resistor is a material whose resistance changes when a force or pressure is applied to it. We have used these in our project mounted on the data glove with flex sensors. 

Final Deliverable of the Project HW/SW integrated systemCore Industry HealthOther Industries Education Core Technology Wearables and ImplantablesOther TechnologiesSustainable Development Goals Good Health and Well-Being for People, Quality Education, Gender Equality, Peace and Justice Strong InstitutionsRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	15066
Flex sensors	Equipment	3	1800	5400
Microcontroller	Equipment	1	2956	2956
Bluetooth module	Equipment	1	500	500
LCD	Equipment	1	500	500
Accelerometer	Equipment	1	360	360
FSR sensor	Equipment	2	2000	4000
Printing and binding of theises	Miscellaneous	3	250	750
Speaker	Equipment	1	600	600