Pakistan sign language conversion to text using Artificial intelligence

The technology is implemented as a wearable hand glove with a finger-by-finger array of flex sensors. Flex sensors are bend sensors, and their resistance varies depending on the bent angle. As a result, the bend resistance of these flex sensors may be estimated based on finger movements, allowing th

Project Title

Pakistan sign language conversion to text using Artificial intelligence

Project Area of Specialization

Internet of Things

Project Summary

The technology is implemented as a wearable hand glove with a finger-by-finger array of flex sensors. Flex sensors are bend sensors, and their resistance varies depending on the bent angle. As a result, the bend resistance of these flex sensors may be estimated based on finger movements, allowing the data collected to discriminate gestures.. The sensor data from the sensor glove are recognised using artificial neural networks. These values are then classified using the English language's 24 alphabets, as well as some words and symbols developed by the author. As a consequence, quiet individuals can use this tool to compose whole sentences.

Project Objectives

The system we want to introduce is a sensor glove system that identifies sign language gestures. The inspiration for this project came from a study of the outcomes of a project named "Talking Hands." The project makes use of a sensor glove to capture a user's Pakistan Sign Language gestures and translate them into English phrases.

Project Implementation Method

We'll be utilizing hand gloves that will be connected to the arduino nano via a wireless connection. By monitoring hand glove movement, arduino can recognise any symbol or hand motion. This data will be transmitted to the arduino nano. All of these gadgets are connected to our application via a wi-fi module. As a result, whatever the person wearing gloves wants to convey will appear on the application's screen.
 

Benefits of the Project

The proposed work's goal is to build and construct a microcontroller-based hybrid system that uses a bend sensor array to identify and measure essential body gestures such as hand gestures. These signals can be used to control how certain device move. it will be helpful in destroyong the barrier of communication between the peopke of pakistan
 

Technical Details of Final Deliverable

First of all, higher-quality flex sensors, gyroscopes, and accelerometers will be used in this project to enhance performance and eliminate errors. Secondly, the system will become wireless in order to communicate data to a smart phone, allowing smart phones to use text to voice and visuals to text applications.This system may be combined with a variety of assistance to support deaf and hard of hearing persons find work. With the controller, we can put remote monitoring at my fingertips. Individual wellbeing is monitored with the help of an activity sensor.
 

Final Deliverable of the Project

Hardware System

Core Industry

IT

Other Industries

Others

Core Technology

Internet of Things (IoT)

Other Technologies

Wearables and Implantables

Sustainable Development Goals

Industry, Innovation and Infrastructure, Peace and Justice Strong Institutions

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com