NaviTalk

Vision is one of the very essential human senses and it plays the most important role in human perception about surrounding environment. According to the World Health Organization, there are approximately 285 million people who are visually impaired. Main constrain that visually impair face are obje

Project Title

NaviTalk

Project Area of Specialization

Artificial Intelligence

Project Summary

Vision is one of the very essential human senses and it plays the most important role in human perception about surrounding environment. According to the World Health Organization, there are approximately 285 million people who are visually impaired. Main constrain that visually impair face are object detection, awareness about the indoor surroundings and navigation restricted by their inability to recognize their surroundings.

The increasing number of people with disabilities in world attracts the concern of researchers to invent various technologies, hoping that these technologies can assist the disabled people in carrying out their tasks in everyday life like normal people. The objective of this project is to create a portable, self-contained, user-friendly system that will allow the visually impaired individuals to navigate without any human guidance.

NaviTalk has proposed a solution consisting of smart glasses integrated with a mobile application that will assist the user in an unfamiliar environment. The system will allow the blind person to detect and avoid objects using the camera and will provide guidance for indoor navigation by voice input and output that would help them to navigate better. NaviTalk, also allows them to request visual assistance from relatives and friends who are sighted by making a video call.

The deliverable of this project are mobile application with glasses, web application, website and a detailed documentation.

Project Objectives

 The objectives of the proposed project are:

• Voice Activated Application.
• Object detection within the indoor environment.
• A navigation system that will be able to guide a blind person safely and with ease, in the indoor environment.
• Allow the blind to request visual assistance from relatives and friends i.e. from those who they can rely on.

Project Implementation Method

The proposed solution 'NaviTalk' consists of smart glasses that will detect the object according to the user input in real-time. After the detection of the object using python’s library ‘opencv’, the analyzing and processing of the object is done by the mobile application built on android studio.

After object detection the navigation will be provided. For navigation, the system will follow ‘dijkstra’s algorithm’ and guide the user the most convenient path to the destination. The user will be guided through navigational directions to reach the destination point i.e., turn to take (left/right/straight) and the number of steps to travel. This process is continued till he/she reaches the destination.

Whenever the blind will need visual assistance, they can easily connect through a live video call with their family members or the people they trust. As a volunteer, they just help by installing and creating an account on the NaviTalk app.

For voice activated application, this project will use Android API. By means that the blind can ask to detect a particular object and navigation through voice input and application respond back to the blind through voice output.

A web application built on php will be delivered for the admin to manage the users and volunteers record through firebase.

Benefits of the Project

The benefits of the proposed project are:

• Glasses will be easy and light to carry just as normal glasses.
• Nearby object detection.
• It will provide indoor navigation for an ease in the blind’s daily routine life.
• Users can avail visual assistance.
• Users can communicate in English or Urdu language.
• No GPS required only need internet connectivity that everyone has in their home or mobile.

Technical Details of Final Deliverable

Technical details of final deliverable are:

• The glasses will be able to detect real-time objects in an indoor environment having a good response time.
• After detection, the system will narrate the directions towards the object i.e. providing navigation to the blind user to reach the object.
• The blind user can request assistance from his family or close friends. The user can add the contacts of those who they rely on rather than getting assistance from a stranger.
• The application listens to your commands and then responds with voice commands in English or Urdu language.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

Health

Other Industries

Core Technology

Artificial Intelligence(AI)

Other Technologies

Wearables and Implantables

Sustainable Development Goals

Good Health and Well-Being for People, Quality Education, Reduced Inequality

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com