Audible Sight

Audible sight is an assistive smart glass and a mobile application which is a highly innovative solution for Pakistan?s visually impaired people. Over 2 million people are blind in Pakistan in which most of them are illiterate. Although, there are many applications specifically designed for blind bu

Project Title

Audible Sight

Project Area of Specialization

Artificial Intelligence

Project Summary

Audible sight is an assistive smart glass and a mobile application which is a highly innovative solution for Pakistan’s visually impaired people. Over 2 million people are blind in Pakistan in which most of them are illiterate. Although, there are many applications specifically designed for blind but we have observed that these applications are not feasible for such people who are not familiar with English Language.  Audible Sight is providing guidance in Urdu Language because it is most understandable language in Pakistan. Main features of this application are object detection, facial expression recognition, communication within community and identification of known person. Object detection feature will recognize the object in real time also the application will read the expression of people and narrate the results in Urdu language. In Communication within community, blind is provided with the service to build a community. If the blind user agrees to avail this service then sighted user (blind’s guardian) will register themselves in respective community. For registration purpose, sighted user has to provide the name, number, picture and relation with the blind user. In Person recognition module, if the user’s camera captures the image of a person who belongs to the blind’s community then application will vocally inform about person existence. This project is aimed to help the blind to be more aware of their surroundings and regain their independence.

Project Objectives

As we believe: “We succeed with technological innovation that benefits everyone across society.” Audible sight is focusing on Pakistan’s visually impaired. Main objectives, aimed to help blind are:

• Give opportunities as others, to fully participate in society.
• Provide assistance in Urdu Language.
• Assistance to understand what’s coming in front.
• Provide awareness of facial expression of people.
• Give awareness of surroundings by assisting, via voice.
• Give a platform to make blind and visually impaired more independent.
• Provide equal opportunities as sighted people in society.
• Provide confidence to enhance social circle.
• Remove the feeling of discomfort from blind and visually impaired during interactions with people.

Project Implementation Method

For Implementation we will use Feature Driven Development FDD (An Agile framework) method. Here is the brief description of FDD:
FDD consists of five high level activities:

Develop an overall domain mode: We will design the mockups including mobile app and web app to understand the overall flow of our project.

Build a list of features:Following is the features list built for the project:

1. Detect the object for recognition
2. Detect the object for identification
3. Detect the facial expression for recognition
4. Build community for communication
5. Recognize people of community by detection
6. Build smart glasses for getting visuals

Design by Feature (DBF): Now the team will proceed by picking any feature and work on its detailed design under the supervision of respective Chief Architect of that feature.
Build by Feature (BBF): Team will then carry out the code development and testing of the features.

Benefits of the Project

• Audible Sight will help blind and visually impaired to make them more independent in their day-to-day activities.
•  To identify objects, they encounter in their daily life without the need for sighted assistance.
•  To help blind users interact with people by understanding  their facial expressions.
•  To provide accessibility service for blinds or others low vision users that let them to hear what they can’t see.
•  Evaluate surroundings with their smart phone and mini camera attached on glasses.
•  To provide a true companion for most of their daily assistants needs.
•  It will reduce the communication barrier for blind by   providing a “Communication within community” feature that let them allow to communicate immediately when they need any guidance from their guardian.
•  To provide audio instructions in the most understandable language i.e. Urdu for blind and vision impaired persons.
•  Blind’s guardian will not have to be all the time with blind to guide them.
•  To get blind user know about their relative who are near to them or in surrounding to identify them.

Technical Details of Final Deliverable

Audible Sight is an eyewear technology (smart glasses) and a mobile application. The lightweight glasses will contain a mini camera with Bluetooth connectivity to capture the image and provide information in real time.
 This project brings the power of Artificial Intelligence to deliver an intelligent Mobile app, designed to help visually impaired people. This application uses mobile camera to capture images with high accuracy to store particular object image in the database.
 Here, we are using the TensorFlow’s object detection API to enable real time detection and google translation API to narrate the results in Urdu language.
 This wearable glass is a highly innovative assistive technology solution for blind or visually impaired people. The result is that user will be able to know about front objects and recognizes friends and people around them, including their emotions, also can interact with the community for guidance via video call.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

IT

Other Industries

Others

Core Technology

Artificial Intelligence(AI)

Other Technologies

Wearables and Implantables

Sustainable Development Goals

Good Health and Well-Being for People, Reduced Inequality

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com