Handgesture

Project Title

Handgesture

Project Area of Specialization Computer ScienceProject Summary

A large number of the Human Resources in Pakistan are being wasted due to the substantial communication gap between the deaf – mute and the other members of the society. Hearing impaired individuals in Pakistan use Pakistani Sign Language to communicate among themselves. However, not many members of the society understand this mode of communication. As a result, there exists a vast communication gap in the society.

In order to resolve this problem, a Gesture Recognition based Sign Language Interpreter is developed that converts Pakistani Sign Language (PSL) to text and speech so that the deaf – mute community can enjoy effective communication with the other members of the society.

This project is user friendly on a number of levels. The glove to be worn by the user is wireless and of less weight. This makes the project not only easy to wear but also easy to use. The communication on the other hand will be created by a mobile application only that gives text and audio to the corresponding gesture made by the user. With this project, we have successfully bridged the communication gap to a fair extent, enabling a healthier life style to the deaf – mute community of Pakistan.

Project Objectives

It is a social cause project for hearing impaired individuals communicates among themselves and other members of the society. It is a user-friendly on a number of levels. It is wireless and of less weight thus can easily be worn. It is a portable design, moreover, wireless data transmission allows the user to handle it freely in public places. Easy to make the change of sensor windows according to wearing hand. It gives audio as well as visual output on an android phone eliminating the need of an extra receiver box as smart phones are now a part of everyone’s life.

Project Implementation Method

At the transmitter side the glove shall be mounted by 5 flex sensor, each on one finger. The flex sensors will be responsible for sensing the flexibility of fingers whenever a sign is made. The output of these 2 sensors combined is sent to the ADC of the AVR Microcontroller. The processed values are then compared with the values in the database and so a particular gesture is recognized by comparing the values. The gesture when recognized is sent to the RF transmitter module to transit the data wirelessly. At the receiver side, the values are analyzed and corresponding command is given to the mobile app screen and the voice module. In this way a voice and a text is received corresponding to every gesture made by the hand in the glove

Benefits of the Project

There is a big major issue in this world for deaf and dumb people to communicate with normal people. Many normal people not recognized sign languages so our application connected with hardware interface which is helpful for the deaf and dumb people who are communicate with normal people easily. People can hand gesture and  come in our application and they are open this application and it will show the Bluetooth activity to set it on the mode on and off  then some instruction will appear on screen and then they moving their fingers the massage  will appear on mobile screen. The use of this app is very easy.

Technical Details of Final Deliverable

-

Final Deliverable of the Project HW/SW integrated systemCore Industry OthersOther Industries IT Core Technology OthersOther Technologies Internet of Things (IoT)Sustainable Development Goals Industry, Innovation and InfrastructureRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	77800
flex based sensor	Equipment	10	4500	45000
HC-05 Bluetooth Module	Equipment	3	4000	12000
Arduino Nano	Equipment	1	6000	6000
Glove	Equipment	8	100	800
battery	Equipment	4	1000	4000
report printing cost	Miscellaneous	40	5	200
travelling and shipments	Miscellaneous	1	9800	9800