AR Helper For Hearing Impaired
This project uses Microsoft Cognitive Services Speech SDK, Blender Animations, Unity Gaming Engine, OpenCV, and Android Studio to create an application that translates speech input into American Sign Language (ASL) real time through an Augmented Reality (AR) approach.
2025-06-28 16:30:17 - Adil Khan
AR Helper For Hearing Impaired
Project Area of Specialization Augmented and Virtual RealityProject SummaryThis project uses Microsoft Cognitive Services Speech SDK, Blender Animations, Unity Gaming Engine, OpenCV, and Android Studio to create an application that translates speech input into American Sign Language (ASL) real time through an Augmented Reality (AR) approach.
Project Objectives- Our aim is to develop such application which can help the hearing impaired individuals to communicate with normal persons. The normal person will not need to communicate with hearing impaired person using sign language.
- To develop an Augmented reality based application for hearing impaired people. To provide information access and services to deaf people.

According to world health organization Over 466 million people of the world are suffers from hearing loss. InterpretAR is a mobile application set to improve the quality of life for individuals who rely on sign language as their main medium of communication. Though the application’s usability extends universally, its main purpose is twofold:
1. To solve everyday inconveniences for the hearing impaired
2. To familiarize individuals afflicted with acute hearing loss with sign language
Technical Details of Final DeliverableWe are using:
- Unity Gaming Engine
- OpenCV
- Android Studio
- Microsoft cognitive speech recognition
| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 32250 | |||
| open cv for unity | Equipment | 1 | 13500 | 13500 |
| unity plus version | Equipment | 1 | 18750 | 18750 |