Urdu Speech to Sign Converter
Human Interaction is the sole of a society. With deaf as its part but limited in their interaction with others they feel isolated. This project focuses on this problem through a recognition process of predefined Urdu sentences that are sampled under varying conditions which will enable a normal pers
2025-06-28 16:36:31 - Adil Khan
Urdu Speech to Sign Converter
Project Area of Specialization Artificial IntelligenceProject SummaryHuman Interaction is the sole of a society. With deaf as its part but limited in their interaction with others they feel isolated. This project focuses on this problem through a recognition process of predefined Urdu sentences that are sampled under varying conditions which will enable a normal person to communicate with a deaf person. The database thus formed involves the basic daily sentences essential for communication is used to train the network up to a maximum efficiency. This network then on the basis of recognition algorithms involved trains itself which is then utilized to recognize the input from a speaker by giving out the most suitable output.
Project Objectives- Recognition of Pre-defined Urdu Sentences.
- Conversion of Recognized Sentences into Relevant Signs.
- Display of Signs on a Screen.
We first start off with the uploading of the speech sentences data set following with the labels of the specified sentences to be recognized. Then we split the data in to training, validation and testing sets. After this we add the background noise files to make the system even more reliable. Then data augmentation is applied on the system which helps to increase the data set sffective size and help prevent the system from over-fitting. We then apply the convolutional neural network that involves an over all of 24 layers with filters in between. Now the training of the system starts which depending on the system specifcations takes almost an hour. After this the network thus formed is available for evaluation. Further it is then integrated with the sign language videos which will be displayed as the output in response to the recognized input.
Benefits of the ProjectOne of the many uses involve:
- Deaf Schools Teaching.
- Household Interaction.
- Offices
- Conference
- Hospitals
The system overall involves softwares like the voice recorder , MATLAB 2018b and video camera for the videos recording
Final Deliverable of the Project Software SystemType of Industry Education Technologies Artificial Intelligence(AI), OthersSustainable Development Goals Good Health and Well-Being for People, Quality Education, Reduced InequalityRequired Resources| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 21900 | |||
| Software Buying | Equipment | 1 | 10000 | 10000 |
| Field Tours | Miscellaneous | 3 | 300 | 900 |
| Persons Recorded | Miscellaneous | 45 | 100 | 4500 |
| Literature Bought | Miscellaneous | 20 | 100 | 2000 |
| Microphone | Equipment | 1 | 2000 | 2000 |
| Printing | Miscellaneous | 10 | 250 | 2500 |