Smart vision based on optical character recognition and eye gaze tracking

Eye tracking refers to the process of measuring where we look, also known as our point of gaze. These measurements are carried out by an eye tracker, which records the position of the eyes and the movements they make. The eye tracker comes up with the micro HD camera faced towards the eye to record

Project Title

Smart vision based on optical character recognition and eye gaze tracking

Project Area of Specialization

Wearables and Implantable

Project Summary

Eye tracking refers to the process of measuring where we look, also known as our point of gaze. These measurements are carried out by an eye tracker, which records the position of the eyes and the movements they make. The eye tracker comes up with the micro HD camera faced towards the eye to record the movement of pupil within the eyes in any direction.

Based on user eye movements capture the area of interest or point of regard that is where user's attention is by camera mount on wearable glasses if user want to read something which he cannot read properly (like dyslexia patients) capture ,extract and convert that written text to speech making user capable of listening what he cannot read properly.   

Project Objectives

The objective of this project is to make up such a wearable like glasses with two attached micro HD cams one facing toward eye to record its position and other for capturing image. Task is to track eye movements and map those movements in relation to the environment that is where an individual is exactly looking at. Based on users attention capture the area of interest by front microHD camera that is where an individual is exactly looking at if there is text present in captured image based on user attention extract and convert that text to speech making the user capable of listening by what he cannot see or read properly.

The main focus of this project to help people who are living with dyslexia which is lifelong disability. Dyslexia is a common learning difficulty that can cause problems with reading, writing and spelling. It's a specific learning difficulty, which means it causes problems with certain abilities used for learning, such as reading and writing. Unlike learning disability, intelligence isn't affected. Dyslexia is a lifelong problem that can present challenges on a daily basis, but support is available to improve reading and writing skills and help those with the problem to be successful at school and work.

Project Implementation Method

The eye tracking glasses will acquire two micro HD cameras one for eye tracking facing towards the eye and other to capture the scene. The eye tracking camera gives the two dimensional movements of eyes in (x, y) coordinates. Based on these movements the scene camera will capture the area of interest based on user gaze attention if there is text present in captured image text it will be extracted and converted to speech output and listened via earphone. The system will uses raspberry pi as its computer.

A technique was employed for eye pupil tracking known as pupil center corneal reflection (PCCR). Near-infrared light is directed towards the center of the eyes (pupil) making clear contrast of pupil in eye, causing visible reflections in the cornea (outer-most optical element of the eye). These reflections – the vector between the cornea and the pupil – are tracked by an infrared eye tracking camera.

An infrared light source (and thus detection method) is necessary as the accuracy of gaze direction measurement is dependent on a clear demarcation of the pupil and the detection of corneal reflection. Normal light sources (with ordinary cameras) aren’t able to provide as much contrast, meaning that an appropriate amount of accuracy is much harder to achieve without infrared light.

The product uses Raspberry Pi as its computer based on python language and advanced image processing and computer vision techniques to perform the required tasks. 

Benefits of the Project

Eye tracking is used across a range of different research fields, and for various different applications within the commercial realm too.

Obtaining detailed information about where an individual or group of people look is useful in a range of contexts, from psychological research, to medical diagnosis, neuro marketing applications and beyond.

The main focus of this project to help people who are living with dyslexia which is lifelong disability. Dyslexia is a common learning difficulty that can cause problems with reading, writing and spelling. It's a specific learning difficulty, which means it causes problems with certain abilities used for learning, such as reading and writing. Unlike learning disability, intelligence isn't affected. Dyslexia is a lifelong problem that can present challenges on a daily basis, but support is available to improve reading and writing skills and help those with the problem to be successful at school and work.

Eye tracking is used across a range of different research fields, and for various different applications within the commercial realm too.

Obtaining detailed information about where an individual or group of people look is useful in a range of contexts, from psychological research, to medical diagnosis, neuro marketing applications and beyond.

Eye tracking other applications:

1. Eye tracking based human computer interaction like cursor control with eyes for disable persons.
2. Eye controlled wheelchairs for disables.
3. Eye tracking in psychology that is when and how people look is essential for understanding how attention is distributed. Eye tracking is widely used within psychological tests.
4. Tracking an individual’s gaze can also be important in medical settings. Studies have shown the potential predictive power of eye tracking in diagnosing autism, as well as other neurological disorders. Future uses may see the application of eye tracking data in providing optimal patient care in healthcare  settings.

Following gaze patterns while people shop has been a growing topic within neuromarketing for many years now. Being able to see what people attend to or ignore can be crucial for implementing optimal packaging design, store layout, and point-of-sale displays

Technical Details of Final Deliverable

The final deliverable will consist of glasses with two attached micro cameras and IR Leds, Ear phone for audio output and control module wired attached which includes raspberry pi with battery backup. The user will have to adjust and train the system before initial use which will require calibration of system according to user once trained .Whenever user will required to read something which he cannot read properly it will just capture image with click and will get speech output of what is written infront of him .

Final Deliverable of the Project

HW/SW integrated system

Type of Industry

Medical , Health

Technologies

Wearables and Implantables

Sustainable Development Goals

Good Health and Well-Being for People, Reduced Inequality

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com