Pakistan sign language conversion to text using Artificial intelligence
The technology is implemented as a wearable hand glove with a finger-by-finger array of flex sensors. Flex sensors are bend sensors, and their resistance varies depending on the bent angle. As a result, the bend resistance of these flex sensors may be estimated based on finger movements, allowing th
2025-06-28 16:28:45 - Adil Khan
Pakistan sign language conversion to text using Artificial intelligence
Project Area of Specialization Internet of ThingsProject SummaryThe technology is implemented as a wearable hand glove with a finger-by-finger array of flex sensors. Flex sensors are bend sensors, and their resistance varies depending on the bent angle. As a result, the bend resistance of these flex sensors may be estimated based on finger movements, allowing the data collected to discriminate gestures.. The sensor data from the sensor glove are recognised using artificial neural networks. These values are then classified using the English language's 24 alphabets, as well as some words and symbols developed by the author. As a consequence, quiet individuals can use this tool to compose whole sentences.
Project ObjectivesThe system we want to introduce is a sensor glove system that identifies sign language gestures. The inspiration for this project came from a study of the outcomes of a project named "Talking Hands." The project makes use of a sensor glove to capture a user's Pakistan Sign Language gestures and translate them into English phrases.
Project Implementation MethodWe'll be utilizing hand gloves that will be connected to the arduino nano via a wireless connection. By monitoring hand glove movement, arduino can recognise any symbol or hand motion. This data will be transmitted to the arduino nano. All of these gadgets are connected to our application via a wi-fi module. As a result, whatever the person wearing gloves wants to convey will appear on the application's screen.
The proposed work's goal is to build and construct a microcontroller-based hybrid system that uses a bend sensor array to identify and measure essential body gestures such as hand gestures. These signals can be used to control how certain device move. it will be helpful in destroyong the barrier of communication between the peopke of pakistan
First of all, higher-quality flex sensors, gyroscopes, and accelerometers will be used in this project to enhance performance and eliminate errors. Secondly, the system will become wireless in order to communicate data to a smart phone, allowing smart phones to use text to voice and visuals to text applications.This system may be combined with a variety of assistance to support deaf and hard of hearing persons find work. With the controller, we can put remote monitoring at my fingertips. Individual wellbeing is monitored with the help of an activity sensor.
| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 68220 | |||
| Arduino Nano R3 | Equipment | 1 | 1252 | 1252 |
| HC-05 Bluetooth Module | Equipment | 1 | 780 | 780 |
| mpu6050 accelerometer | Equipment | 1 | 520 | 520 |
| Bluetooth module | Equipment | 1 | 880 | 880 |
| flex sensor | Equipment | 10 | 2000 | 20000 |
| resistance box | Equipment | 1 | 2867 | 2867 |
| Arduino cable | Equipment | 1 | 120 | 120 |
| Battery | Equipment | 1 | 2425 | 2425 |
| Gyroscopes | Equipment | 1 | 17377 | 17377 |
| Bluetooth Aurdionic Speakers | Equipment | 1 | 6499 | 6499 |
| Raspberry pi 4 | Equipment | 1 | 15500 | 15500 |