Real time Sign Language to Text and Text to sign Language Interpreter
According to the World Health Organization there are about 466 million people in the world that are deaf or suffer from disabling hearing loss. Deaf people can communicate with sign language and normal people do not understand the sign language. We are proposing a system to facilitate the interactio
2025-06-28 16:28:55 - Adil Khan
Real time Sign Language to Text and Text to sign Language Interpreter
Project Area of Specialization Artificial IntelligenceProject SummaryAccording to the World Health Organization there are about 466 million people in the world that are deaf or suffer from disabling hearing loss. Deaf people can communicate with sign language and normal people do not understand the sign language. We are proposing a system to facilitate the interaction among deaf people’s and normal people. The main objective is to increase the awareness towards hearing impaired people that can facilitate the community. We are proposing a system (mobile application) that will convert sign language to text (English) and text (English) to sign language.
Project ObjectivesTo develop a system that can facilitate basic human interactions of impaired people. Creating more facilities towards special education. Making it easy to learn sign language.
Project Implementation MethodWe will be using an incremental development model for our project because “Due to iterative effort in testing and fine-tuning, the software will have minimal defects. Thanks to the transparent development model, there is better clarity between team members during development. Changes in project requirements can be easily addressed and rectified with little or no impact on the timeline and will be incorporated with coming increments. Provides an overall improvement on the final quality of the custom software development.”
Benefits of the ProjectTo benefit the deaf community so that they can interact with normal people and can participate in the nation’s development.
Technical Details of Final DeliverableWe will develop an android application that will convert signs to text in real-time and text to signs of (ASL) sign language.
Sign Language Conversion:
Building an AI model through machine learning that can convert the user’s sign input to text and likewise other user’s text input to visualized sign language on the mobile screen, all in real-time.
Text to Speech:
Using TensorFlow libraries to use the Sign Converted text by converting it to Speech output and then playing the Audio on Phone Speakers for the continual and barrier-less communication from the Deaf/Mute to the other person.
Speech to Text:
Similarly converting the normal user’s Speech to Text for the Sign Language input so they can easily communicate rather than typing the text this module converts their speech to text for the input of sign language which will convert it into visual signs for the deaf.
This will ensure fluent communication between both The Deaf & Normal users.
Final Deliverable of the Project HW/SW integrated systemCore Industry HealthOther Industries IT Core Technology Artificial Intelligence(AI)Other Technologies Others, Big DataSustainable Development Goals Good Health and Well-Being for People, Quality Education, Industry, Innovation and Infrastructure, Sustainable Cities and CommunitiesRequired Resources| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 75000 | |||
| Osmo DJI | Equipment | 1 | 41000 | 41000 |
| Amazon SageMaker | Equipment | 1 | 24000 | 24000 |
| Delivery & Data Creation | Miscellaneous | 1 | 10000 | 10000 |