Eye Gaze Tracking for Wheelchair Control

The crux of the project is to develop an accurate program that steers and directs a wheelchair by tracking direction of movement of the eye gaze.

2025-06-28 16:27:10 - Adil Khan

Project Title

Eye Gaze Tracking for Wheelchair Control

Project Area of Specialization Artificial IntelligenceProject Summary

The crux of the project is to develop an accurate program that steers and directs a wheelchair by tracking direction of movement of the eye gaze.

Project Objectives

Our project aims to benefit physically disabled people that require a wheelchair for their conveyance, focusing the strength of this project on those that are paralyzed and hence highly dependent on others for their transport.  The objective is to design a wheelchair that is controlled by the movement of the eye such that the varying positions of the pupil will steer the wheelchair and hence align the movement with the gaze of the user.  This will lead to a certain amount of independence and control of the user on his life and for his basic needs as the control of the wheelchair will  be signaled by using the mechanism of eye tracking. Our project aims to incorporate tracking of single eye as well as with the presence of mask.

Project Implementation Method

The functionality of the proposed system depends on the principles of computer vision. It will use images of eye pupils as inputs. The USB camera attached to the wheel chair will be capturing images of the person's pupil in order to track its movement. These images will then be fed to the Raspberry Pi that will be using algorithms to process these images. These algorithms will determine the eye location on the face as well as track the eye pupil movements. The raspberry pi will then generate command signals as according to the processed images that will be fed to the motor driving system connected to it. The motor driving system will then steer the wheel chair in the directions as according to the signals received.

Our project aims to incorporate tracking of single eye as well as with the presence of mask.
 
An optional feature that the system may incorporate is obstacle detection using an ultrasonic detector and hence work towards obstacle avoidance.

Benefits of the Project

People who suffer from mobility related disabilities face many difficulties in activities of daily life .One of the major ones is that they are not able to move from one place to another without help from others. Although there are wheelchairs available for their help so that they can move without a caretaker but most of them either work with the help of a joystick or manually and hence, those suffering from paralysis are still at a loss and are unable to steer their own ship. To overcome this issue, our project designs the pupil detection and tracking version of a wheel chair that uses USB camera and a highly trained system that detects and tracks the movements of the user's pupil and moves the wheelchair accordingly.  
 
People suffering from spinal cord injuries and quadriplegic paralysis may also suffer from depression due to their inability to be in control of their actions and movement.  The project aims to assist such people by facilitating in their mobility, self-care and overall improving their standard of life Optionally, the wheelchair may also observe the environment using Ultrasonic sensors and use obstacle detection and avoidance techniques to obtain a clearer path. 
 
This wheel chair not only helps the paralyzed people but it is also helpful for their caretakers as it allows the patients to move without any help once they are on the wheelchair. 
 
Such features allow the user to be self-sufficient in doing some basic yet important things in life.  
 
The applications are not just limited to the health-care industry. The system can be applied in maneuvering drones, aircrafts and in teleoperated robots. The tracking aspect can be used to control operations on a  computer or mobile. Moreover,  the mechanism of eye detection and tracking can be used as signaling for various domestic applications as well such as controlling the appliances of a house. 
 
 

Technical Details of Final Deliverable

Electric Wheelchair that uses a USB camera attached to it for capturing images that are fed to raspberry pi to process and track the direction of motion the gaze.

Final Deliverable of the Project HW/SW integrated systemCore Industry HealthOther IndustriesCore Technology Artificial Intelligence(AI)Other Technologies OthersSustainable Development Goals Good Health and Well-Being for PeopleRequired Resources
Item Name Type No. of Units Per Unit Cost (in Rs) Total (in Rs)
Total in (Rs) 66642
raspberry pi Equipment192009200
Arduino Equipment115001500
cables and converters Equipment129862986
Webcam Equipment130003000
Clamps, Casings and protection for circuitry and equipment Equipment129852985
Touch-screen LCD Equipment170007000
Wheel-chair (repair) Equipment149874987
Miscelleneous Hardware(Sensors etc.) Equipment149844984
Stationey, transport, printing, miscelleneous Miscellaneous 150005000
Main Motor Equipment11500015000
Secondary motors Equipment11000010000

More Posts