Computer Vision Based Communication Assistance For Audibly Impaired
A portable device to allow anyone to communicate using signs by converting them into voice. This is a project aimed to give voice to help those who cannot speak.
Project Title
Computer Vision Based Communication Assistance For Audibly Impaired
Project Area of Specialization
Project Summary
A portable device to allow anyone to communicate using signs by converting them into voice. This is a project aimed to give voice to help those who cannot speak.
Project Objectives
Our aim is to create a wearable, portable yet affordable solution that will allow sign to voice communication. We are targetting American Sign Language due to it's popularity as well as cater to any unique signs that are present in local communities to help deaf people as much as we can.
Project Implementation Method
Our solution utilizes a Raspberry Pi with a camera module that captures the sign being performed and speaks the word associated with it. This is done by sending by the video to a server running a deep learning network that sends back the prediction to the Pi, which outputs by speaking the word via a speaker connecting to the Pi.
Benefits of the Project
- Helping anyone who cannot talk
- Affordable
- Portable
- Easy to use.
- Caters to custom gestures.
Technical Details of Final Deliverable
We chose a Raspberry Pi as it has the specifications as it can easily run Python code, has its own camera module for easy interfacing, can be powered by a power bank to make it portable and has network capability which allows us to communicate with a server running a very accurate deep learning network for robust predictions.
Currently our model is achieving a 99.6% accuracy with 30% data used for validation, on the ASL Kaggle dataset, using transfer learning on ResNet50.
Final Deliverable of the Project
Type of Industry
Technologies
Sustainable Development Goals
Required Resources
| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Raspberry Pi | Equipment | 2 | 5950 | 11900 |
| Rapberry Pi camera module V2 | Equipment | 1 | 3495 | 3495 |
| Pi case | Equipment | 1 | 450 | 450 |
| Power Adapter | Equipment | 1 | 760 | 760 |
| Shipping Cost | Miscellaneous | 2 | 250 | 500 |
| Power Bank | Equipment | 1 | 2000 | 2000 |
| Memory Card | Equipment | 1 | 500 | 500 |
| 5 inch touch screen hdmi lcd for raspberry pi | Equipment | 1 | 3800 | 3800 |
| self adhesive pure copper heat sink for raspberry pi | Equipment | 1 | 300 | 300 |
| Mini Beauty Speaker With Selfie Spotlight For Mobile Phone - Golden | Equipment | 1 | 449 | 449 |
| Mini Pillow Speaker Earphone Headphone- White | Equipment | 1 | 270 | 270 |
| Total in (Rs) | 24424 |
If you need this project, please contact me on contact@adikhanofficial.com
Design and Application of Auto Recloser Relay
This project develops an automatic tripping mechanism for three-phase transmission system....
Hafeez Center Online Sale and Purchase System
In this project we are providing online facility to user to buy and sell their products th...
Smart Energy management Switch (SENSe) for Real Time Monitoring and Co...
In the modern world, with the increase in technology, energy has become the most important...
Play2Z
Augmented reality holds an important promise for improving the educational system as a who...
Facial Recognition Security System in Automotive Vehicle
OVERVIEW OF THE SYSTEM From this, we have implemented theft control techniques that can pr...