MULTILINGUAL SIGN LANGUAGE GENERATOR
Multilingual Sign Language Generator is used so that a normal person can convey their message to a hearing-impaired person. The application can be installed in an android mobile or tablet and can support video, audio and text input where text can be in any form i.e. pdf or docx. This application cur
Project Title
MULTILINGUAL SIGN LANGUAGE GENERATOR
Project Area of Specialization
Project Summary
| Multilingual Sign Language Generator is used so that a normal person can convey their message to a hearing-impaired person. The application can be installed in an android mobile or tablet and can support video, audio and text input where text can be in any form i.e. pdf or docx. This application currently supports American Sign Language and Pakistan Sign Language. More languages can be added dynamically without change in code. The project can be used in daily life to share your comments with hearing impaired persons. It can be used in institutes for teaching special people. Our application can also generate sign language for live / recorded news, lectures and speeches as well. It is also beneficial for converting audio-video tutorial / lecture into Sign Language based video tutorials. The application will be developed using Android SDK with Java as programming language. |
Multilingual Sign Language Generator is used so that a normal person can convey their message to a hearing-impaired person. The application can be installed in an android mobile or tablet and can support video, audio and text input where text can be in any form i.e. pdf or docx. This application currently supports American Sign Language and Pakistan Sign Language. More languages can be added dynamically without change in code. The project can be used in daily life to share your comments with hearing impaired persons. It can be used in institutes for teaching special people. Our application can also generate sign language for live / recorded news, lectures and speeches as well. It is also beneficial for converting audio-video tutorial / lecture into Sign Language based video tutorials. The application will be developed using Android SDK with Java as programming language.
Project Objectives
- To enhance communication with hearing-impaired people
- Ease of learning sign language
- Multilingual support for sign languages
- Increase Job opportunities for hearing-impaired people
- Videos Sharing for educational content
Project Implementation Method
- Develop an interface for the application.
- Create a database of words using SQLite.
- Give input in the form of text, speech, audio, and pdf etc.
- Extract text from the given inputs. i.e. speech, audio, and pdf etc.
- Images of signs against words of that text are extracted from the gallery of android device
- Images are merged and played like a video
- User can also make a video tutorial of that video.
Benefits of the Project
- Daily life: Ease in Communication with hearing-impaired people and conversation with family, friends, doctor and shopkeepers
- Educational life: Schools for hearing-impaired children and Sign Language based Video sharing Portal
- Social life: Social Media Text Translation in Sign Language and Sign Creation for live / recorded News at TV channels
Technical Details of Final Deliverable
The android application will take input as text, audio file, video file and website/PDF data. The application dynamically tokenize the sentences and then the appropriate images of each sign are extracted from repository for different words. The selected images are merged together to make a video in proper sequence as per sentence structure. The video can be shared or be saved.
The application maintains separate repository for different Sign Languages including PSL, ASL and CSL stored inside cell-phone’s internal memory. Each word is searched in the repository of that language and the number of frames will be fetched from there to prepare final sign language based video.
Final Deliverable of the Project
Core Industry
Other Industries
Core Technology
Other Technologies
Sustainable Development Goals
Required Resources
| Elapsed time in (days or weeks or month or quarter) since start of the project | Milestone | Deliverable |
|---|---|---|
| Month 1 | Proposal. | Document |
| Month 2 | SRS. | Document |
| Month 3 | Application Front End for designing forms for android. Apply layouts and designing flow of screens. | Android apk |
| Month 4 | Obtain library of images for sign language of Pakistan Sign Language and American Sign Language. Prepare code to Take Text from library and generate words of Sign Language. | Android apk |
| Month 5 | Take sentences and display signs based video that may be saved. Add more signs for mostly spoken words and gestures. | Android apk |
| Month 6 | Extract text from speech, and convert it to Sign Language. | Android apk |
| Month 7 | Extract long text from PDF, Docx, and Website and covert to Sign Language based video. | Android apk |
| Month 8 | Improve conversion time and reduce size of video to share on social media or email. | Android apk |
| Month 9 | Provide support for sharing videos on social media and email. | Android apk |
| Month 10 | Online storage for collection of Signs and download RAR gradually at the time of installation as per level of sign usage like basic, average and advanced levels. Place images at proper location in cell-phone. | Android apk |
| Month 11 | Support for dynamically adding new signs and even new languages like American SL, Chinese Sign Language, and finalize the repository of signs for frequently spoken words and gestures. | Android apk |
| Month 12 | Testing the quality and accuracy of application. | Android apk |
If you need this project, please contact me on contact@adikhanofficial.com
Real Time Crowd Counting COVID SOPs Detection System
Social distancing has been proven as an effective measure against the spread of the infect...
Talk Code
?Code The Way You Talk?. Talk code is an innovative Desktop Application that is going to a...
Real Life Health Bar Game
Every Game that we play do not involve the human physical involvement so we will try to ma...
IOT based garbage and sewage monitoring system
It is an iot based garbage n sewage monitoring system. As future is of technology n of iot...
Landslide prediction using wireless sensor network using IoT
Landslides are geological hazards which cause a great deal of loss and damage to public li...