See Through Me: An Assistive Application for the Blind

All our surroundings contain visual information which makes it difficult for visually impaired people in performing even simple daily tasks such as finding the color of an object.  Such people will be immensely helped with the help of an assistive technology that can understand their surroundin

Project Title

See Through Me: An Assistive Application for the Blind

Project Area of Specialization

Software Engineering

Project Summary

All our surroundings contain visual information which makes it difficult for visually impaired people in performing even simple daily tasks such as finding the color of an object.  Such people will be immensely helped with the help of an assistive technology that can understand their surroundings and provide hints or information regarding them. We propose a smart assistive mobile application that helps blind and visually impaired users to read the text and understand their surroundings with the help of voice commands. It provides a set of digital eyes to make the physical world more accessible for the blind and low vision community.

Project Objectives

The main goal of the project is to develop an assistive application for the blind to make their daily life easier. The objectives of the project are to:

• Provide an application that is able to take a set of voice commands as perform the required action.
• Provide an application that can use device's camera to recognize text and objects and then provide voice descriptions about what it sees.
• Provide an application with the capability to detect the dominant color of the object in front of the camera and describe it.

Project Implementation Method

The project is an android application that will be initiated by the google voice command accessibility in the android Operating system. The user will be able to initiate an object recognizer or color identifier using the voice commands. The camera will be opened up and the application shall provide the classification result as speech output.

The functional layer is composed of at least three different modules:

• Speech processing module: The application will be capable of navigation based on voice commands
• Color identification module: The application shall have an integrated AI module that is able to recognize the dominant color at the center of the screen in real time.
• Object and Text recognition module: The application contains integrated Machine Learning API / models to recognize all the objects and text present in the camera and vocalize the list of results. 

Benefits of the Project

• The project shall provide ease in the life of blind or partially impaired people. 
• The project will provide a cost effective solution to the problem of understanding their surrounding with already available sophisticated AI models in the palm of the hand. 

Technical Details of Final Deliverable

An android application will be the final deliverable of the project which contains:

• Speech processing (recognition + synthesis) module
• On device object recognition and text recognition module using MLkit API
• Dominant Color detection module

Final Deliverable of the Project

Software System

Core Industry

IT

Other Industries

Core Technology

Artificial Intelligence(AI)

Other Technologies

Sustainable Development Goals

Good Health and Well-Being for People

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com