Sign language recognition using hand gestures

This SH converter will work for people with disabilities in speaking to learn communication in Sign Language, lack of difficulty in communicating by providing their gestures in the text of people who do not know Sign Language. There will be two

Project Title

Sign language recognition using hand gestures

Project Area of Specialization

Artificial Intelligence

Project Summary

This SH converter will work for people with disabilities in speaking to learn communication in Sign Language, lack of difficulty in communicating by providing their gestures

in the text of people who do not know Sign Language.

There will be two functionalities which are for communication and education. The communication module is for translating gestures to the text. Gestures will be searched among gestures that have been introduced to the system. The education module will be some kind of game and has a menu which shows phrases/words correspond to predefined gestures. User will choose one of them and perform the gesture. Then, whether the gesture is performed correctly or not, the user will get feedback from this interface and prompt a message about the correct gesture and its meaning.

In terms of hardware, only a PC and camera is necessary. Gestures will be captured by the camera. Our product aims to work in a PC environment. 

Operating System: Windows, MacOS  

Programming Language: Python

Development Environment: OpenCV, Deep learning.

 

Project Objectives

The objective of our software is to develop a user-friendly application for deaf and speechless people who are not able to communicate like other normal people. This application will help them develop conversation with each other and with other people who are unable to understand sign language, this application will convert the sign language text into english and vice versa.

Project Implementation Method

In order to maintain the accuracy, following assumptions are made:  

The user should stand between 1.8 to 2.4 meters away from the camera.

The hand tracking phase should be properly done by the user.  

The program will work on a PC environment mainly. 

The reactivity of the program depends on the camera’s recognition ability. 

The application does not have any safety and security concerns.

 

Benefits of the Project

The purpose of this software is to make the life of deaf and speechless people easy by giving them a platform to communicate with each other and to other normal people who don't know sign language therefore are unable to communicate with special people.This software has vast scope and can be utilized at large scale events and social islamic gatherings.It could be used at reception desks or during video conferences to allow signing people to speak with people who don't know the Sign Language

Technical Details of Final Deliverable

Our program will have two main functionality; namely communication and education. Both of these modules have two common stages:  Capturing the hand movements through camera.

Python provides real time position and depth information about multiple points in the human hand. OpenCV will enable us to capture human hand movement live via camera feed and take action according to the gesture of the human hand.

The program will compare the movement performed by the user with predefined movements(Gestures) in its database. 

The difference between two modules is their output forms.Education module decides whether the gesture is performed correctly and returns a true/false value whereas the communication module displays the meaning of the performed gesture and message of the correct gesture and its meaning.

 

Final Deliverable of the Project

Software System

Core Industry

IT

Other Industries

Core Technology

Artificial Intelligence(AI)

Other Technologies

Sustainable Development Goals

Industry, Innovation and Infrastructure, Reduced Inequality

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com