Communication System for People with Locked In Syndrome
Locked-in syndrome is a rare neurological disorder in which there is complete loss of all voluntary movements of muscles except for the eye. Similar to Paralysis, it is the loss of voluntary muscle movement. Our project will enable the patients of this disease to commuincate with those around t
2025-06-28 16:30:51 - Adil Khan
Communication System for People with Locked In Syndrome
Project Area of Specialization Artificial IntelligenceProject SummaryLocked-in syndrome is a rare neurological disorder in which there is complete loss of all voluntary movements of muscles except for the eye. Similar to Paralysis, it is the loss of voluntary muscle movement. Our project will enable the patients of this disease to commuincate with those around them. We will be developing a communication system for people suffering from locked-in syndrome which will allow these patients to be able to express themselves. Our project will allow the patients to control this software with their eyes. They will be able to control the software and communicate with the people around them and express themselves simply by blinking their eyes.
Project Objectives- Eyes will be detected
- Eye mapping will be detected
- Eye blinks will be converted into text
- User will be able to communicate with those around them
The laptop will be placed at a safe distance from the patient and the software will be started. Desktop will be placed at such a position where the patient’s eyes will be visible. Patient will be able to see rows of alphabets. One row will be highlighted at a time. After some time the next row will be highlighted. This will be repeated until the patient blinks intentionally. When the patient blinks intentionally, that row will be selected. Then in that row, each of the characters will be highlighted one at a time until the patient intentionally blinks. And then that letter will appear on screen. A beep sound will be made to tell the patient that their blink has been detected. It will also predict what the patient is trying to write based on the software’s history. Then the patient will have the option to recite what he’s typed on the desktop screen.
We will differentiate between intentional and unintentional blinks by determining how long does a blink last. If a blink lasts more than a determined time, say 1.5 seconds, then it will be intentional otherwise it will be discarded as unintentional.
Eye blinks can be detected in three ways. One of them being detecting the Eye Blinks using facial landmarks. We can use Dlib to detect facial landmarks in Python. Then we can use the Eye Aspect Ratio Equation to determine whether the eyes are open or closed. It will give a constant value when the eyes are open. And 0 when the eyes will be closed.
Some gestures related to the eye will be mapped in the software which will control the software. The gestures will be taught to the software to be recognized using machine learning.
Benefits of the Project- People with Locked-in Syndrome will be able to communicate with everyone around them
- People with other similar forms of paralysis will be able to communicate witht those around them
- These people who were not able to do much will be able to do simple things like ordering food from websites and order other miscellaneous items according to their needs
Component Diagram:
User:
User will be a patient with Locked-In Syndrome who is only able to move his eye. He’ll be interacting with our application using a Camera.
Camera:
Camera will get video input and pass it to PC/Laptop to perform Desired Operations.
PC/Laptop:
It will be running the application and use the video feed provided by the Camera to aid the user in communication.
Architecture Diagram:
Decision Table:
Sequence Diagram:
Type Text by Blinking
Add Space by Single Blink
Delete by Single Blink
Text to Speech
Collaboration Diagram:
DFD Context Level:
DFD Level 0:
&a
Final Deliverable of the Project Software SystemCore Industry OthersOther IndustriesCore Technology Artificial Intelligence(AI)Other TechnologiesSustainable Development Goals Good Health and Well-Being for PeopleRequired Resources| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 66000 | |||
| Nvidia Geforce GTX 1060 4GB | Equipment | 1 | 30000 | 30000 |
| Logitech C270 | Equipment | 1 | 6000 | 6000 |
| Tobii Eyetracker 4c | Equipment | 1 | 30000 | 30000 |