MULTILINGUAL SIGN LANGUAGE GENERATOR
Multilingual Sign Language Generator is used so that a normal person can convey their message to a hearing-impaired person. The application can be installed in an android mobile or tablet and can support video, audio and text input where text can be in any form i.e. pdf or docx. This application cur
2025-06-28 16:34:13 - Adil Khan
MULTILINGUAL SIGN LANGUAGE GENERATOR
Project Area of Specialization Computer ScienceProject Summary| Multilingual Sign Language Generator is used so that a normal person can convey their message to a hearing-impaired person. The application can be installed in an android mobile or tablet and can support video, audio and text input where text can be in any form i.e. pdf or docx. This application currently supports American Sign Language and Pakistan Sign Language. More languages can be added dynamically without change in code. The project can be used in daily life to share your comments with hearing impaired persons. It can be used in institutes for teaching special people. Our application can also generate sign language for live / recorded news, lectures and speeches as well. It is also beneficial for converting audio-video tutorial / lecture into Sign Language based video tutorials. The application will be developed using Android SDK with Java as programming language. |
Multilingual Sign Language Generator is used so that a normal person can convey their message to a hearing-impaired person. The application can be installed in an android mobile or tablet and can support video, audio and text input where text can be in any form i.e. pdf or docx. This application currently supports American Sign Language and Pakistan Sign Language. More languages can be added dynamically without change in code. The project can be used in daily life to share your comments with hearing impaired persons. It can be used in institutes for teaching special people. Our application can also generate sign language for live / recorded news, lectures and speeches as well. It is also beneficial for converting audio-video tutorial / lecture into Sign Language based video tutorials. The application will be developed using Android SDK with Java as programming language.
Project Objectives- To enhance communication with hearing-impaired people
- Ease of learning sign language
- Multilingual support for sign languages
- Increase Job opportunities for hearing-impaired people
- Videos Sharing for educational content
- Develop an interface for the application.
- Create a database of words using SQLite.
- Give input in the form of text, speech, audio, and pdf etc.
- Extract text from the given inputs. i.e. speech, audio, and pdf etc.
- Images of signs against words of that text are extracted from the gallery of android device
- Images are merged and played like a video
- User can also make a video tutorial of that video.
- Daily life: Ease in Communication with hearing-impaired people and conversation with family, friends, doctor and shopkeepers
- Educational life: Schools for hearing-impaired children and Sign Language based Video sharing Portal
- Social life: Social Media Text Translation in Sign Language and Sign Creation for live / recorded News at TV channels
The android application will take input as text, audio file, video file and website/PDF data. The application dynamically tokenize the sentences and then the appropriate images of each sign are extracted from repository for different words. The selected images are merged together to make a video in proper sequence as per sentence structure. The video can be shared or be saved.
The application maintains separate repository for different Sign Languages including PSL, ASL and CSL stored inside cell-phone’s internal memory. Each word is searched in the repository of that language and the number of frames will be fetched from there to prepare final sign language based video.
Final Deliverable of the Project Software SystemCore Industry ITOther Industries Education , Media , Telecommunication Core Technology OthersOther Technologies OthersSustainable Development Goals Good Health and Well-Being for People, Quality EducationRequired Resources| Elapsed time in (days or weeks or month or quarter) since start of the project | Milestone | Deliverable |
|---|---|---|
| Month 1 | Proposal. | Document |
| Month 2 | SRS. | Document |
| Month 3 | Application Front End for designing forms for android. Apply layouts and designing flow of screens. | Android apk |
| Month 4 | Obtain library of images for sign language of Pakistan Sign Language and American Sign Language. Prepare code to Take Text from library and generate words of Sign Language. | Android apk |
| Month 5 | Take sentences and display signs based video that may be saved. Add more signs for mostly spoken words and gestures. | Android apk |
| Month 6 | Extract text from speech, and convert it to Sign Language. | Android apk |
| Month 7 | Extract long text from PDF, Docx, and Website and covert to Sign Language based video. | Android apk |
| Month 8 | Improve conversion time and reduce size of video to share on social media or email. | Android apk |
| Month 9 | Provide support for sharing videos on social media and email. | Android apk |
| Month 10 | Online storage for collection of Signs and download RAR gradually at the time of installation as per level of sign usage like basic, average and advanced levels. Place images at proper location in cell-phone. | Android apk |
| Month 11 | Support for dynamically adding new signs and even new languages like American SL, Chinese Sign Language, and finalize the repository of signs for frequently spoken words and gestures. | Android apk |
| Month 12 | Testing the quality and accuracy of application. | Android apk |