Hand Gesture Recognition for DEAF and DUMB peoples

Project Title

Hand Gesture Recognition for DEAF and DUMB peoples

Project Area of Specialization Information & Communication TechnologyProject Summary

This project deals with the detection and recognition of hand gestures. Images of the hand gestures are taken using a Android cell phone and matched with the images in the database and the best match is returned. Gesture recognition is one of the essential techniques to build user-friendly interfaces. For example, a robot that can recognize hand gestures can take commands from humans, and for those who are unable to speak or hear, having a robot that can recognize sign language would allow them to communicate with it. Hand gesture recognition could help in video gaming by allowing players to interact with the game using gestures instead of using a controller. However, such an algorithm needs to be more robust to account for the myriad of possible hand positions in three-dimensional space. It also needs to work with video rather than static images. That is beyond the scope of our project.

Project Objectives

Gesture recognition systems in general can be divided into three main components: Image preprocessing, tracking, and gesture recognition. In individual systems some of these components may be merged or missing, but their basic functionality will normally be present:

1)   Image preprocessing: The task of preparing the video frames for further analysis by suppressing noise, extracting important clues about the position of the hands and bringing these on symbolic form. This step is often referred to as feature extraction. 

2)   Tracking: On the basis of the preprocessing, the position and possibly other attributes of the hands must be tracked from frame to frame. This is done to distinguish a moving hand from the background and other moving objects, and to extract motion information for recognition of dynamic gestures. 

3)   Gesture recognition: Based on the collected position, motion and pose clues, it must be decided if the user is performing a meaningful gesture. The knowledge about the hands used for the tracking and recognition can exist on different levels of abstraction. Two main approaches exist in this regard dif8 ferentiated by whether the system is based on an abstract model of the hand or on knowledge of the appearance of the hand in the image:

Project Implementation Method

1.  Methodology

The Design Phase of the project started in early december, and we will continue working on the following aspects:

2.Design Data Crawling Techniques

We will design algorithms to periodically crawl the social networking websites and collect data for our database.

3.Design data mining algorithms

We will design some data mining algorithms to find useful data in our database…

4.Design the user interface

We will design a user interface that is easy to use and can display psychological profiles and lists of similar students based on similar personality traits.

5.Implementation

The Implementation Phase will include the following aspects:

6.Build the database

Based on our ER diagram, we will use My SQL to build our psychological profile database.

Benefits of the Project

Hand gestures are not just hand waving. We have now shown you that gestures enhance learning in children who view and make them. Furthermore, children’s gestures reveal when they are on the cusp of understanding a new concept. An important unanswered question that scientists are still trying to figure out is how? How do gestures help learning?

Even though we do not yet have an answer to this, scientists have some ideas. One possibility is that gestures offer a visual way to communicate ideas that can complement what children hear or say with spoken language. Instead of just hearing something in speech, children get to see it as well. Another possibility is that gestures help children focus their attention on the most important points of what is being learned, at exactly the right time. For example, when children are learning about mathematical equivalence and are being told, “this side is equal to this side,” the teacher’s gestures can bring children’s attention to the relevant pieces as they talk. Gestures increase the chance that the children will know exactly which part of the equation the teacher is talking about. Finally, it is also possible that gestures help memory by engaging more parts of the brain. Gesturing engages the motor (movement) parts of the brain in addition to the parts of the brain already active for producing language. Engagement of multiple brain areas may lead to better, deeper learning.

These unanswered questions are exciting opportunities for scientists to better understand how we learn and remember. Gestures come along for free with our speech and can play a critical role in helping children learn. By continuing to study gestures, we will better understand how we can help children learn both in the classroom and out.

Have you noticed your teachers gesturing in class? If not, it is time to tell them to start!

Technical Details of Final Deliverable

A deliverable is a tangible or intangible good or service produced as a result of a project that is intended to be delivered to a customer (either internal or external). A deliverable could be a report, a document, a software product, a server upgrade or any other building block of an overall project.[3] A deliverable may be composed of multiple smaller deliverables. It may be either an outcome to be achieved (as in "The corporation says that becoming profitable this year is a deliverable") or an output to be provided (as in "The deliverable for the completed project consists of a special-purpose electronic device and its controlling software").

Some deliverables are dependent on other deliverables being completed first; this is common in projects with multiple successive milestones.[4] In this way many time-savings are possible, shortening greatly the whole project final supply term. This designing activity can be represented in the drawings with a "cloud" around a not yet designed part which means: "this part (size, or other characteristics) will be studied later". The part settled can be "delivered" to the interested parties.

A deliverable differs from a project milestone in that a milestone is a measurement of progress toward an output, whereas the deliverable is the output delivered to a customer or sponsor.[5] For a typical project, a milestone might be the completion of a product design, while the deliverable might be the technical diagram or detailed design report of the product.

In technical projects, deliverables can be further classified as hardware, software, or design documents. In contracted efforts, deliverable may refer to an item specifically required by contract documents, such as an item on a contract data requirements list or mentioned in the statement of work.

Final Deliverable of the Project Hardware SystemCore Industry TelecommunicationOther Industries IT , Others Core Technology Artificial Intelligence(AI)Other Technologies OthersSustainable Development Goals No PovertyRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	59184
sensors	Equipment	4	6000	24000
camera	Equipment	1	14000	14000
gloves	Equipment	2	2000	4000
machine	Equipment	2	5000	10000
stationary	Miscellaneous	8	898	7184