Smart Gloves for converting sign to speech

About 9 billion people around the globe are deaf-mute which is an effective percentage of the world's population. This population only communicate with each others using motion of their hand and expressions. As the name indicates in this project, we use different sensors for detection of motion and

Project Title

Smart Gloves for converting sign to speech

Project Area of Specialization

Biomedical Engineering

Project Summary

About 9 billion people around the globe are deaf-mute which is an effective percentage of the world's population. This population only communicate with each others using motion of their hand and expressions. As the name indicates in this project, we use different sensors for detection of motion and it's conversion to text and speech. According to dump people, for every movement they make, there exists a unique meaning for that. That message is kept in a database. 

Project Objectives

1- The basic objective of our project is to develop a portable device for the people who suffer from speech impairment, providing them an aid to communicate easily.

2- The project aims to lower the communication gap between the mute community and additionally the standard world. The projected methodology interprets language into speech.

3- The project is meant to be a prototype to check the feasibility of recognizing sign language using sensor gloves.

4- Sign language are not easy to recognize as they are difficult to understand and also highly complex to learn. The day to day functioning of people with disabilities can be developed and improved by use of products based on assistive technology. 

Project Implementation Method

This project uses controller to control all the processes and data gloves includes Force Sensitive Resistors(FSR) ad flex sensors along with accelerometer /gyroscope sensor will track the movement of fingers as well as the entire palm. The system combines these signals from all sensors to generate a digital code, which corresponds with a particular letter. To differentiate between similar gestures, the glove is also equipped with an accelerometer. Codes into a string of written letters, and sends them via Bluetooth to be displayed on a Smartphone. The coded data from Arduino is given to android mobile by using Bluetooth module. The database will be created for different alphabets of American Sign Language in the android phone. When the input data matches with the data in the database then we will get the required output and translate the gesture into corresponding speech. A LCD will be used corresponding text. This project will be further developed to recognize words. 

Benefits of the Project

* Usable for physically challenged people.

* Communication between mute people and normal people.

* Medical application.

* For educational purpose.

* Gesture control of remote devices.

* Conveying information related operations.

* In public place for announcements. 

Technical Details of Final Deliverable

Materials and Methods:

1- Data Glove

Data glove consists of flex sensors. Flex sensors (also called bend sensors) are flexible sensor which support gestures of the hand which is sensed by the dete or.

2- Flex Sensors

A flex sensor or a bend sensor is a sensor that measures the amount of reflection or bending. It is a variable resistor like no others. It's terminal resistance changes when it is bending. It does not have polarized terminals like diode. So there are no positive and negative terminals. 

3- Accelerometer and gyroscope

In this project we have to use some equipment for sensing rotation of hand and fingers. There are two sensors for this purpose i.e gyroscope and accelerometer. We compared both of their functionality and then implement using one of them. The main difference between the two devices is simple: one can sense rotation, whereas other cannot. In comparison, the accelerometer measures linear acceleration based on vibration. Moreover gyroscopes are more expensive so we preferred using Accelerometer.

4- FSR Sensor

A force-sensitive resistor is a material whose resistance changes when a force or pressure is applied to it. We have used these in our project mounted on the data glove with flex sensors. 

Final Deliverable of the Project

HW/SW integrated system

Core Industry

Health

Other Industries

Education

Core Technology

Wearables and Implantables

Other Technologies

Sustainable Development Goals

Good Health and Well-Being for People, Quality Education, Gender Equality, Peace and Justice Strong Institutions

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com