Smart gadget for visually impaired people

For all the about statement problems, we are proposing gadget for visually impaired Peoples. In this Project, we will provide a platform for blind people to help interact with real world. They will be able to read books or newspaper through NLP. Through facial recognition, they will be able t

Project Title

Smart gadget for visually impaired people

Project Area of Specialization

Internet of Things

Project Summary

For all the about statement problems, we are proposing gadget for visually impaired Peoples.

In this Project, we will provide a platform for blind people to help interact with real world. They will be able to read books or newspaper through NLP. Through facial recognition, they will be able to detect the person with said gender and age. Objects will also be detected which are in front of them through object detection. They will also navigate the location or address.

In Pakistan or in the rest of the world there are a lot of visually impaired people. They face multiple problems throughout their life’s. The main purpose of our gadget is to help them in their regular life challenging activities like reading a book or a newspaper. for this purpose, this gadget will capture the image of a book or newspaper, convert it into text form and then voice by NLP, which can be easily listen by visually impaired person. Mostly visually impaired people are unable to detect the other person or unknown person in front of them. By using this gadget, they will easily distinguish the name, gender and age by facial recognition process. Visually impaired people also face difficulty in navigating a location or address, this device helps them to track the exact location through GPS system.  We can run this gadget. For this purpose of mic connect it with raspberry pi. suppose visually impaired person are telling where are me? so gadget run this algorithm and tell him your is abc location. Visually impaired person tells close so close the algorithm. and then same work to multiple things through gadget by voice. So the main purpose of this project is to solve the daily challenging problems of visually impaired peoples. This is gadget for visually impaired peoples.

Project Objectives

The main objective is to make a smart gadget which is capable to solve their problems for visually impaired peoples.

Our project will mainly focus on the following objectives:

1. To capture the image and then analyze the words then convert to speech through NLP.
2. This gadget will be helpful to detect the known person name through facial recognition.
3. To identify the age of unknown person through facial recognition.
4. Gadget will be helpful to analyze the gender of unknown person through facial recognition.
5. Gadget help Objects will also be detected which are in front of them through object detection.
6. They will also navigate the location or address.
7. The main objective of this project is to solve their problems for visually impaired peoples so that they will not face difficulty in future.

Project Implementation Method

firstly we have implemented the facial recognition module  using open cv haarscascade method and using lbph algorithm. secondly we implement the age and gender detection through pre trained caffe_model. then we performed object detections for using multiple methods tensorflow, caffe_model but we are using the tensorflow through object detection in this project. then we have implemented the obstacle detection through lidar sensor and self adjusment obstacle detection. then we have implemented the natural language processsing through book reading . then we have implementing location for finding gps neo mv2 and then at the history maintain. 

Benefits of the Project

smart gadget  help for blind peoples 

> help for person face recognizing.

> help for object and obstacle detection for blind people.

> help for book reading.

> help for location finding.

Technical Details of Final Deliverable

• Selection of parts.
• Gathering of parts.
• Integrating hardware.
• Installing raspberry pi operating system and imported libraries on raspberry pi.
• facial recognition:

1. writing an algorithm for facial detection and sample saving.
2. Writing an algorithm for training of facial detection.
3. Writing an algorithm for run time base of facial recognition.

• Voice:

1. Writing an algorithm for converting text to speech.
2. Writing an algorithm for converting speech to text.

• Creating a Machine learning base model for age and gender detection.
• Training base model for age and gender detection.

Writing an algorithm for location.

• Building a model for real time conversion of text from image.
• Writing an algorithm for run time base click image and go to the model to ask which text.
• Writing an algorithm for object detection.
• Final testing.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

IT

Other Industries

Medical , Health

Core Technology

Internet of Things (IoT)

Other Technologies

Sustainable Development Goals

Good Health and Well-Being for People

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com