Gesture Talk

Project Title

Gesture Talk

Project Area of Specialization Wearables and ImplantableProject Summary

As we all know some people cannot speak an oral language or have some degree of speaking ability, but choose not to speak because of the negative or unwanted attention atypical voices sometimes attract. Such people communicate using sign language

Around 3,77,179 people in Pakistan out of 180.7 million are deaf & mute. The number of deaf-mutes in the world are roughly calculated to be from 700,000 to 900,000 and of these 63 percent, are said to be born deaf, the others losing their hearing by different accidents. The number of deaf-mutes in Great Britain amount probably to about 20,000.

Project Objectives

The presented work is a communication bridge between normal and deaf & dumb people. The product “Gesture Talk” can be used as an interpreter between normal and deaf persons. The gesture talk is based on Pakistan Sign Language (PSL), which is a standard language used by deaf persons in Pakistan. Using gesture talk PSL can translate into voice, which can be understood by a normal person. This will reduce the communication gap between normal and deaf persons. The idea is to develop a small portable application which can be used as a middle layer application between normal and deaf & dumb people.

Project Implementation Method

The project proposes a framework for recognizing hand gesture, which would serve as a way of communication between deaf & dumb and normal people.  First we take input from user in the form of hand gestures.

Thus, there is a need of a proper translator. This application will take the sign language (gestures) as an input and will translate into voice as output to meaningful data as voice.

To develop this application we will first develop our own database by recording multiple sample gestures. To make our product efficient, several gesture patterns will be recorded by number of individuals. The application contains gestures of characters, words and small sentences to translate into voice (audio file).

This voice will be the output of our product as complete speech.

Benefits of the Project

•The deliverable output will be a small portable application instead of heavy circuitry.

•This project can overcome the gap of communication between hard of hearing people and normal persons

•Rechargeable system with easy human interface.

•No need to wear any unnecessary gloves.

•Due to light weight it is easy to carry anywhere anytime.

•Dumb persons will be able to communicate in daily routine life in general public like stores, shops and in places where most people are not aware about the sign language

•It uses Pakistan Sign Language(PSL) as a communication medium.

•Now instead of hesitating, the deaf & dumb people will be communicating with everyone and sharing their feelings freely

Technical Details of Final Deliverable

Our target is to make a small portable product as an electronic device that will convert hand gestures into speech for those who are with hearing and speaking impairment. It will be consists of both hardware and software. Hardware will be having sensor for taking input, speaker for speech output and a processor for converting and taking samples of hand gesture to process. Software will be having coding for project.

Final Deliverable of the Project HW/SW integrated systemType of Industry Others Technologies Wearables and ImplantablesSustainable Development Goals Good Health and Well-Being for PeopleRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	50500
MYO Gesture control armband	Equipment	1	32500	32500
Raspberry pi 3 Model B	Equipment	1	5000	5000
Mini Speaker	Equipment	2	2000	4000
3D Body	Miscellaneous	3	2000	6000
Memory Card	Miscellaneous	2	1000	2000
Raspberry pi case	Miscellaneous	1	1000	1000