Adaptive Sign Language Translator

Summary: To bridge the communication gap between deaf and normal people by developing a portable smart hand glove system that helps them to convert hand gestures into text and speech. The glove translates sign language gestures into text and speech. The glove translates sign language gesture

Project Title

Adaptive Sign Language Translator

Project Area of Specialization

Wearables and Implantable

Project Summary

Summary:

To bridge the communication gap between deaf and normal people by developing a portable smart hand glove system that helps them to convert hand gestures into text and speech. The glove translates sign language gestures into text and speech. The glove translates sign language gestures into speech according to the ASL (American Sign Language), PSL (Pakistani Sign Language) and OSL (Other Sign Language: Through adaptive sign language translator).
A glove is developed along with an android Application. It contains three main modules (Smart Learning, Self-Evaluation and communication). Smart learning contains sub modules; dictionary and gallery. Through gallery user can learn different gestures through images and videos. Self-
evaluation contains ASL and PSL sign guessing quiz. The sign guessing quiz will provide user different MCQ’S. Symbol based test provide user different alphabets and user has to perform a gesture accordingly. Through communication module user can communicate using ASL, PSL and OSL. User should perform gesture (wearing glove) which will be converted into text and speech (on Android Application). App main feature is adaptive which is available in communication module and dictionary through which user can add new symbols.
Adaptive Sign Language Translator helps deaf people to interact with normal people. As well as for the peoples from other communities with different sign language. It is based on need of developing a product that can translate sign language in text and speech it gives voice to the deaf people.

Project Objectives

OBJECTIVES:

The main goal of the project is to bridge the communication gap between deaf and normal people by developing a portable smart hand glove system that helps them to convert hand gestures into text and speech. The glove translates sign language gestures into text and speech. The glove
translates sign language gestures into speech according to the ASL (American Sign Language), PSL (Pakistani Sign Language) and OSL (Other Sign Language: Through adaptive sign language translator). Deaf people to interact with normal people. As well as for the peoples from other
communities with different sign language. It is based on need of developing a product that can translate sign language in text and speech it gives voice to the deaf people.

Project Implementation Method

This software is an Android based Application and their modules are smart learning which also contains sub modules; dictionary and gallery. Through gallery user can learn different gestures by the help of images and videos. Self-evaluation contains ASL and PSL sign guessing quiz and symbol test. The sign guessing quiz will provide user different MCQ’S. Symbol based test provide user different alphabets and user has to perform a gesture accordingly. Through communication module user can communicate using ASL, PSL and OSL. User should perform gesture (wearing glove) which will be converted into text and speech (on Android Application).
App main feature is adaptive which is available in communication module and dictionary through which user can add new symbols.
The Hardware Interface consists of a glove which contains Flex Sensors, Contact Sensors, Arduino Nano, Bluetooth Module, Battery and connecting wires. After performing a Gesture, Flex Sensors and Contact Sensors send their values to Arduino which convert the analogue value to digital and match those with predefined symbols and send that to the Mobile Application via Bluetooth Module.

Benefits of the Project

This product is very useful, as it can be used worldwide you can add different gestures at run time using adaptive feature whereas in previous sign language translators this facility is not available. This system is less time consuming. As soon as the gesture is performed it convert it to text and speech. User is able to judge his knowledge regarding sign language through ASL and PSL quizzes and tests. This system glove is portable you can carry it anywhere and can use it with app by connecting it through Bluetooth.

Technical Details of Final Deliverable

This software is an Android based Application and their modules are smart learning which also contains sub modules; dictionary and gallery. Through gallery user can learn different gestures by the help of images and videos. Self-evaluation contains ASL and PSL sign guessing quiz and symbol test. The sign guessing quiz will provide user different MCQ’S. Symbol based test provide user different alphabets and user has to perform a gesture accordingly. Through communication module user can communicate using ASL, PSL and OSL. User should perform gesture (wearing glove) which will be converted into text and speech (on Android Application).

App main feature is adaptive which is available in communication module and dictionary through which user can add new symbols.
The Hardware Interface consists of a glove which contains Flex Sensors, Contact Sensors, Arduino Nano, Bluetooth Module, Battery and connecting wires. After performing a Gesture Flex Sensors and Contact Sensors send their values to Arduino which convert the analogue value to digital and match those with predefined symbols and send that to the Mobile Application via Bluetooth Module.

Final Deliverable of the Project

HW/SW integrated system

Type of Industry

IT

Technologies

Wearables and Implantables

Sustainable Development Goals

Reduced Inequality

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com