Hand assisting device for deaf and mute people

Deaf and dumb people use hand gestures to communicate with people. Normal people cannot understand a mute person?s hand signs. To make this communication possible we proposed the idea of glove-based technology. This technology helps mute people to translate their hand gestures into voice and text.

Project Title

Hand assisting device for deaf and mute people

Project Area of Specialization

Internet of Things

Project Summary

Deaf and dumb people use hand gestures to communicate with people. Normal people cannot understand a mute person’s hand signs. To make this communication possible we proposed the idea of glove-based technology. This technology helps mute people to translate their hand gestures into voice and text.

The signal that deaf people use is a communication skill that is gestures instead of sound to convey their message. In most cases, ordinary people find it difficult to understand sign language and for people who cannot speak or lose their ability to speak in some cases, it becomes difficult for them to convey their message within society. With the technological advancement of modern times, people are increasingly depending on modern techniques, dumb and deaf people need to use them to overcome everyday difficulties which can help them integrate socially and professionally.

Therefore, there is a need to develop asystem which can help to translate the sign language into text and voice toensure the effective communication can be easily take place in this community.

Hand Talk usually converts the hand movements/gestures which are made by the disabled person and converts it to a Voice message or it will display it on an LCD/Mobile APP as a text message.

Project Objectives

The main objective of this project is to help deaf and unalbe to talk people by removing communication barriers so that they are not restricted in a small social circle and can convey their feelings and emotions whenever they want.

Smart Glove-Turns sign language into text and speech.

Hand Talk is an assistive technology for deaf and dumb people.

Project Implementation Method

This is comprised of flex sensors on its fingers. When user will give any input by bending flex sensors. The output data from Flex Sensors will be given as input to Raspberry Pi and also vibration and motion of user’s hand from Accelerometer as input. Raspberry Pi then will process the input data according to program written on it, and will give output data through Bluetooth (BT) HC-05 to Mobile App (Raspberry Pi BT Text to Speech), which will show the output message which is desired by user and will read loudly according to gestures and programming.

Benefits of the Project

This smart hand assistive technology enables people to live productive, independent, and dignified lives. It’s an efficient and easy way of communication for deaf and unable to talk people which is called hand talk.

This project is proposed to improve lifestyle of deaf and unable to talk people. This is also favorable for degrading the communication difference between the deaf or unable to talk person or with average person.

Hand Talk is an assistive technology for deaf and dumb people.

This technology helps the mute people to translate their hand gestures into voice and text

Technical Details of Final Deliverable

Flex Sensors: This flex sensor is a variable resistor like no other. The resistance of the flex sensor increases as the body of the component bends.

Accelerometer MPU-6050: An accelerometer is a device that measures the vibration, or acceleration of motion of a structure.

Raspberry Pi: is a tiny and affordable computer that you can use to learn programming through fun, practical projects, build hardware projects, do home automation, and even use them in industrial applications.

Bluetooth HC-05: HC-05 Bluetooth Module is an easy to use Bluetooth SPP (Serial Port Protocol) module, designed for transparent wireless serial connection setup. Its communication is via serial communication which makes an easy way to interface with controller or PC.

This system works on basis of sensors and Raspberry Pi. The hand signals which are sensed by the flex sensor which is fitted to each finger of the hand glove. Based on the bending of flex sensor a desired resistance and corresponding voltage is detected. The output is further fed through the Raspberry Pi as input and it will check for the predefined value in it. If the predefined value matches with the given input the system will display the corresponding output message through voice box shield or LCD/Mobile display.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

IT

Other Industries

Manufacturing

Core Technology

Wearables and Implantables

Other Technologies

Internet of Things (IoT), Robotics

Sustainable Development Goals

Industry, Innovation and Infrastructure, Reduced Inequality, Peace and Justice Strong Institutions

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com