Any one can talk(Automated tool for two way sign language and audio translation)

Sign language is a natural way for communication between normal and the deaf and dumb people, but often they find difficulty in communicating with normal people as they don?t understand their sign language. Therefore, there always exists a language barrier. To overcome this barrier, we propos

Project Title

Any one can talk(Automated tool for two way sign language and audio translation)

Project Area of Specialization

Robotics

Project Summary

Sign language is a natural way for communication between normal and the deaf and dumb people, but often they find difficulty in communicating with normal people as they don’t understand their sign language.

Therefore, there always exists a language barrier. To overcome this barrier, we propose a device which can convert their hand gestures into voice which a normal person can understand. It will also help out the deaf and dumb people to understand what a normal person is saying by watching their sign language on a screen.

This device consists of a Wireless Glove, consisting of flex sensors and accelerometer. These sensors sense the movement of hands and fingers.

This system consists of a two way speech synthesizer software which converts these movements of hand into real time speech output and a display will give the text for the corresponding gesture.

While on the other hand it will convert the speech of the healthy person into sign language so that the patient can understand.

Project Objectives

This system will be useful for dumb and deaf  people to communicate with blind and normal people.

This system will convert the sign language into voice and text which is easily understandable by blind and normal people. The sign language is translated into some text form, to facilitate the deaf people as well.

This system will work for both platforms i.e. PCs and Android to make it portable for people

This text will be displayed on LCD on PC and on mobile screens while using android app. In order to improve and facilitate the more gesture recognition, motion processing unit like wireless gloves can be installed which comprises of accelerometer as well and with the help sensor fusion technique, we can accommodate a number of other gestures as well for better and efficient communication.

Project Implementation Method

The dictionary for hand gestures and their corresponding words in english will be compiled by studying different disabled subjects. The dictionary will initally be made in English, covering all the basic hand gestures. Advanced vocabulary will not be included.

This project will include fifty basic words for the language of gestures. It will also include all the 26 alphabets and numbers from 0-9.

skills required are

• API integration for voice synthesis.
• Socket programming.
• Basic electrical engineering to design and implement wireless gloves.
• Arduino programming

Benefits of the Project

This system will be useful for dumb and deaf  people to communicate with blind and normal people.

This system will convert the sign language into voice and text which is easily understandable by blind and normal people. The sign language is translated into some text form, to facilitate the deaf people as well.

This system will work for both platforms i.e. PCs and Android to make it portable for people

This text will be displayed on LCD on PC and on mobile screens while using android app. In order to improve and facilitate the more gesture recognition, motion processing unit like wireless gloves can be installed which comprises of accelerometer as well and with the help sensor fusion technique, we can accommodate a number of other gestures as well for better and efficient communication.

Technical Details of Final Deliverable

Making smart glove using flex sensors, aurdino, accelerometer, microphones and speakers.

Final Deliverable of the Project

Hardware System

Core Industry

IT

Other Industries

Education , Medical

Core Technology

Robotics

Other Technologies

Artificial Intelligence(AI)

Sustainable Development Goals

Good Health and Well-Being for People, Quality Education, Reduced Inequality

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com