Urdu Speech to Sign Converter
Human Interaction is the sole of a society. With deaf as its part but limited in their interaction with others they feel isolated. This project focuses on this problem through a recognition process of predefined Urdu sentences that are sampled under varying conditions which will enable a normal pers
Project Title
Urdu Speech to Sign Converter
Project Area of Specialization
Project Summary
Human Interaction is the sole of a society. With deaf as its part but limited in their interaction with others they feel isolated. This project focuses on this problem through a recognition process of predefined Urdu sentences that are sampled under varying conditions which will enable a normal person to communicate with a deaf person. The database thus formed involves the basic daily sentences essential for communication is used to train the network up to a maximum efficiency. This network then on the basis of recognition algorithms involved trains itself which is then utilized to recognize the input from a speaker by giving out the most suitable output.
Project Objectives
- Recognition of Pre-defined Urdu Sentences.
- Conversion of Recognized Sentences into Relevant Signs.
- Display of Signs on a Screen.
Project Implementation Method
We first start off with the uploading of the speech sentences data set following with the labels of the specified sentences to be recognized. Then we split the data in to training, validation and testing sets. After this we add the background noise files to make the system even more reliable. Then data augmentation is applied on the system which helps to increase the data set sffective size and help prevent the system from over-fitting. We then apply the convolutional neural network that involves an over all of 24 layers with filters in between. Now the training of the system starts which depending on the system specifcations takes almost an hour. After this the network thus formed is available for evaluation. Further it is then integrated with the sign language videos which will be displayed as the output in response to the recognized input.
Benefits of the Project
One of the many uses involve:
- Deaf Schools Teaching.
- Household Interaction.
- Offices
- Conference
- Hospitals
Technical Details of Final Deliverable
The system overall involves softwares like the voice recorder , MATLAB 2018b and video camera for the videos recording
Final Deliverable of the Project
Type of Industry
Technologies
Sustainable Development Goals
Required Resources
| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Software Buying | Equipment | 1 | 10000 | 10000 |
| Field Tours | Miscellaneous | 3 | 300 | 900 |
| Persons Recorded | Miscellaneous | 45 | 100 | 4500 |
| Literature Bought | Miscellaneous | 20 | 100 | 2000 |
| Microphone | Equipment | 1 | 2000 | 2000 |
| Printing | Miscellaneous | 10 | 250 | 2500 |
| Total in (Rs) | 21900 |
If you need this project, please contact me on contact@adikhanofficial.com
IOT based petrol pump security and monitoring system
The market demand for efficient fuel management, as well as the ability to control an...
Control box assembly in fcs systems.
Our project name is control box assembly in fire control systems.In control box there are...
KinoCric Cricket Bowling Action Analysis through Digital Markers
KinoCrick is a project which will analyze the cricket bowler's action as valid or invalid....
Plastic Recycling Machine
In the beginning we have to consider the PLASTICS (PET,PE and , PVC etc). In Pakistan are...
Automated monitoring suspicious discussion using data mining.
Introduction: The internet is a very Convenient and effective way for people and agencies...