Adil Khan 1 year ago
AdiKhanOfficial #FYP Ideas

Computer Vision Based Communication Assistance For Audibly Impaired

A portable device to allow anyone to communicate using signs by converting them into voice. This is a project aimed to give voice to help those who cannot speak.

Project Title

Computer Vision Based Communication Assistance For Audibly Impaired

Project Area of Specialization

Artificial Intelligence

Project Summary

A portable device to allow anyone to communicate using signs by converting them into voice. This is a project aimed to give voice to help those who cannot speak.

Project Objectives

Our aim is to create a wearable, portable yet affordable solution that will allow sign to voice communication. We are targetting American Sign Language due to it's popularity as well as cater to any unique signs that are present in local communities to help deaf people as much as we can.

Project Implementation Method

Our solution utilizes a Raspberry Pi with a camera module that captures the sign being performed and speaks the word associated with it. This is done by sending by the video to a server running a deep learning network that sends back the prediction to the Pi, which outputs by speaking the word via a speaker connecting to the Pi.

Benefits of the Project

  1. Helping anyone who cannot talk
  2. Affordable
  3. Portable
  4. Easy to use.
  5. Caters to custom gestures.

Technical Details of Final Deliverable

We chose a Raspberry Pi as it has the specifications as it can easily run Python code, has its own camera module for easy interfacing, can be powered by a power bank to make it portable and has network capability which allows us to communicate with a server running a very accurate deep learning network for robust predictions.

Currently our model is achieving a 99.6% accuracy with 30% data used for validation, on the ASL Kaggle dataset, using transfer learning on ResNet50.

Final Deliverable of the Project

HW/SW integrated system

Type of Industry

IT

Technologies

Artificial Intelligence(AI)

Sustainable Development Goals

Good Health and Well-Being for People

Required Resources

Item Name Type No. of Units Per Unit Cost (in Rs) Total (in Rs)
Raspberry Pi Equipment2595011900
Rapberry Pi camera module V2 Equipment134953495
Pi case Equipment1450450
Power Adapter Equipment1760760
Shipping Cost Miscellaneous 2250500
Power Bank Equipment120002000
Memory Card Equipment1500500
5 inch touch screen hdmi lcd for raspberry pi Equipment138003800
self adhesive pure copper heat sink for raspberry pi Equipment1300300
Mini Beauty Speaker With Selfie Spotlight For Mobile Phone - Golden Equipment1449449
Mini Pillow Speaker Earphone Headphone- White Equipment1270270
Total in (Rs) 24424
If you need this project, please contact me on contact@adikhanofficial.com
0
291
MatMath

Math is the cradle of all creations, without which the world cannot move an inch. Mathemat...

1675638330.png
Adil Khan
1 year ago
VR AE

Studies indicate that Virtual Reality is a promising Ed-Tech innovation as it is 400% more...

1675638330.png
Adil Khan
1 year ago
plantable paper products

Every drop of water makes the mighty ocean  We strongly agree with this quote . every...

1675638330.png
Adil Khan
1 year ago
Class Attendance System with Web Display and Automatic Timetable Gener...

The aim of this work was to provide an effective way of taking attendance of students and...

1675638330.png
Adil Khan
1 year ago
Design and implementation of real time MPPT

In our Project, we are designing an MPPT (Maximum Power Point Tracking device) for solar p...

1675638330.png
Adil Khan
1 year ago