Computer Vision Based Communication Assistance For Audibly Impaired
A portable device to allow anyone to communicate using signs by converting them into voice. This is a project aimed to give voice to help those who cannot speak.
2025-06-28 16:30:53 - Adil Khan
Computer Vision Based Communication Assistance For Audibly Impaired
Project Area of Specialization Artificial IntelligenceProject SummaryA portable device to allow anyone to communicate using signs by converting them into voice. This is a project aimed to give voice to help those who cannot speak.
Project ObjectivesOur aim is to create a wearable, portable yet affordable solution that will allow sign to voice communication. We are targetting American Sign Language due to it's popularity as well as cater to any unique signs that are present in local communities to help deaf people as much as we can.
Project Implementation MethodOur solution utilizes a Raspberry Pi with a camera module that captures the sign being performed and speaks the word associated with it. This is done by sending by the video to a server running a deep learning network that sends back the prediction to the Pi, which outputs by speaking the word via a speaker connecting to the Pi.
Benefits of the Project- Helping anyone who cannot talk
- Affordable
- Portable
- Easy to use.
- Caters to custom gestures.
We chose a Raspberry Pi as it has the specifications as it can easily run Python code, has its own camera module for easy interfacing, can be powered by a power bank to make it portable and has network capability which allows us to communicate with a server running a very accurate deep learning network for robust predictions.
Currently our model is achieving a 99.6% accuracy with 30% data used for validation, on the ASL Kaggle dataset, using transfer learning on ResNet50.
| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 24424 | |||
| Raspberry Pi | Equipment | 2 | 5950 | 11900 |
| Rapberry Pi camera module V2 | Equipment | 1 | 3495 | 3495 |
| Pi case | Equipment | 1 | 450 | 450 |
| Power Adapter | Equipment | 1 | 760 | 760 |
| Shipping Cost | Miscellaneous | 2 | 250 | 500 |
| Power Bank | Equipment | 1 | 2000 | 2000 |
| Memory Card | Equipment | 1 | 500 | 500 |
| 5 inch touch screen hdmi lcd for raspberry pi | Equipment | 1 | 3800 | 3800 |
| self adhesive pure copper heat sink for raspberry pi | Equipment | 1 | 300 | 300 |
| Mini Beauty Speaker With Selfie Spotlight For Mobile Phone - Golden | Equipment | 1 | 449 | 449 |
| Mini Pillow Speaker Earphone Headphone- White | Equipment | 1 | 270 | 270 |