Adil Khan 1 year ago
AdiKhanOfficial #FYP Ideas

Isharay

A mobile application which helps deaf people communicate with other people by working as a translator from sign language to text and vice versa using mobile camera and 3d modelling. 

Project Title

Isharay

Project Area of Specialization

Artificial Intelligence

Project Summary

A mobile application which helps deaf people communicate with other people by working as a translator from sign language to text and vice versa using mobile camera and 3d modelling. 

Project Objectives

  • Converting sign language to text.
  • Converting text to sign language.

Project Implementation Method

PHASE1:

      Conversion of Sign language to text.

DATA COLLECTION:

      Collection of video data of words/phrases in sign language  from different websites.

DATA CLEANING:

      Organizing those videos into a single usable format with unified frames per seconds (fps) for our model.

KEYPOINT DETECTION:

      Detection of hand motion and collection of 21 keypoints of  each hand in a single frame.

DATA TRANSLATION:

       Converting the above mentioned keypoints into vectors for our machine learning model.

MODEL TRAINING:

       Training of model on these vectors to classify videos against words/phrases of sign language.

PHASE2:

        Conversion of text to sign language.

3D MODEL:

        Making of a 3D Human Model to demonstrate sign language words/phrases.        

ANIMATION:

       Animating the model in sign language gestures against the words/phrases (text) from user.

PUBLIC PORTAL:

      Allowing users to add new words in the vocabulory considering the regional differences in sign language.

Benefits of the Project

  • Diminishing the barrier between normal and deaf people .
  • Making the lives of hearing-impaired more independent.
  • Creating job opportunities for deaf people.
  • Making the learning of sign language easy for deaf people.

Technical Details of Final Deliverable

A mobile application that will convert text to sign language and sign language to text using mobile device.

The keypoint detection is being done by using a TensorFlow model in C++

After that these keypoints are converted to a vector which will be  used to train a model in python using a neural network.

This model will be used in the mobile device or cloud to convert the sign language video to text

The 3D model will be used to convert text to sign language gestures by animation of the model.

There will also be an option to add more sign language words/phrases by user to overcome the regional differences of sign language. 

Final Deliverable of the Project

Software System

Core Industry

Education

Other Industries

IT , Others , Telecommunication

Core Technology

Artificial Intelligence(AI)

Other Technologies

Artificial Intelligence(AI)

Sustainable Development Goals

Good Health and Well-Being for People, Quality Education, Reduced Inequality

Required Resources

Item Name Type No. of Units Per Unit Cost (in Rs) Total (in Rs)
External Docker for Graphic Card EXP GDC Beast External Graphics Card Dock Equipment12000020000
Nvidia GTX 1070 Equipment15000050000
Total in (Rs) 70000
If you need this project, please contact me on contact@adikhanofficial.com
0
206
Findzer

Problem # 1: Many people got accidents due to traveling or some other reasons. Helper, Pol...

1675638330.png
Adil Khan
1 year ago
Scholarly Search Engine

Students and new Researchers can not easily detect the non indexed research papers/low qua...

1675638330.png
Adil Khan
1 year ago
Antenna Design for Underwater Radio Communication

This Project is about designing an antenna that will work in water with same properties as...

1675638330.png
Adil Khan
1 year ago
Let\'sTalk

This application provides a better and flexible system for communicate with others. It is...

1675638330.png
Adil Khan
1 year ago
Design of wide band Metasurface for microwave Application

          In proposed project we aim to design low profile,lightw...

1675638330.png
Adil Khan
1 year ago