Adil Khan 10 months ago
AdiKhanOfficial #FYP Ideas

Novel Gesture Based Augmentative and Alternative (AAC) Communication System for The Deaf and Hard of Hearing Individuals

Communication for differently abled individuals has always been a challenging task. To address this problem, we present a model of an App, developed on the foundation of machine learning and is constructed using TensorFlow and OpenCV. The App would incorporate various signs and translate it into tex

Project Title

Novel Gesture Based Augmentative and Alternative (AAC) Communication System for The Deaf and Hard of Hearing Individuals

Project Area of Specialization

Computer Science

Project Summary

Communication for differently abled individuals has always been a challenging task. To address this problem, we present a model of an App, developed on the foundation of machine learning and is constructed using TensorFlow and OpenCV. The App would incorporate various signs and translate it into text when detected by camera. The scope of the project lies in the fact that it is an application, making it an efficient user interface (UI) design.

Project Objectives

To design an efficient system for hard of hearing individuals that will help them in conveying their message with able individuals.  

Project Implementation Method

The method we used to build a sign language detector is by working on the TensorFlow object detection API and Python. In the first phase, we collected our images using Python and OpenCV and then we labelled them  using the label image package. In the second phase, we trained the TensorFlow for sign language. In the third phase, we detected sign language in real time. In the final stage, we will build a web application, making it an efficient user interface (UI) design.

Benefits of the Project

This system will be an essential tool to bridge the communication gap between able and hearing-impaired people.

Technical Details of Final Deliverable

  • Training tensorflow for sign language.
  • Building app for detection.
  • Detecting Sign Language in real time.

Final Deliverable of the Project

Software System

Core Industry

IT

Other Industries

Core Technology

Artificial Intelligence(AI)

Other Technologies

Sustainable Development Goals

Good Health and Well-Being for People

Required Resources

Item Name Type No. of Units Per Unit Cost (in Rs) Total (in Rs)
Quadro P620 V2 Graphics Card Equipment15500055000
SSD (500 GB) Equipment160006000
Total in (Rs) 61000
If you need this project, please contact me on contact@adikhanofficial.com
Design And Fabrication Of Series Hybrid Solar Assist Recumbent E Trike

The interest to find an alternative mode of vehicles has seen a considerable growth in the...

1675638330.png
Adil Khan
10 months ago
Development and Characterization of Seamless Actuators for Medical App...

The current interest on soft robotics and their application in rehabilitation practices ar...

1675638330.png
Adil Khan
10 months ago
Virtual Reality Lab

In this project we address the issue of conducting labs in an online environment and the d...

1675638330.png
Adil Khan
10 months ago
IoT based Electromyography and speech controlled Robotic Car using Ras...

Wearable electronic equipment is continually improving and becoming more integrated with t...

1675638330.png
Adil Khan
10 months ago
Smart Garbage Monitoring and Waste Collection System with Garbage Sort...

At present, in our city we see that the existing garbage bins placed at public places...

1675638330.png
Adil Khan
10 months ago