IoT based Assistive Robot

In today?s world, a huge amount of people are facing visual impairment or are completely blind. It is tough for them to spend life in a normal manner. Therefore, lack of sight is a great problem and visually impaired people depend on the help of sighted people to guide them and accompany them t

Project Title

IoT based Assistive Robot

Project Area of Specialization

Internet of Things

Project Summary

In today’s world, a huge amount of people are facing visual impairment or are completely blind. It is tough for them to spend life in a normal manner. Therefore, lack of sight is a great problem and visually impaired people depend on the help of sighted people to guide them and accompany them to find the way. Such disabilities result in mobility limitations and thus the autonomy of a person is significantly compromised in his/her daily life. In this project a device is proposed to help blind to navigate around freely or independently and without the need of the other person to help them. The speedy acceptance of smart assistive technologies for blinds in the environments is a source of ease and convenience in their life. Our aim to design a cost friendly and unique IoT based assistive robot that is free of the drawbacks found in previous invention, minimizes the limitations for the blinds and thus would be a complete guide for them. The prominent features of the device include detection of objects, wall, stairs or hole using IR and Sonar sensors, detection of facial expressions and gestures through artificial intelligence and image processing by using open CV, notifying the person through vibrator or sound notifications in case of any hurdle. The device will replace human assistance with a robotic guide of blind. 

Project Objectives

General Objectives

General objectives which have been expected to be achieved from this composition are the use of sensors within Internet of Things (IoT) technology to supply an integrated prototype to aid visually impaired people in daily routine.

Specific Objectives

The proposed system will:

• Detect obstacles, walls, stairs, holes, fire to advantage and expertise of the talents that sensors presently have.
• Detect facial expressions to examine the opportunities in the future for this era.
• Detect gestures to broaden the functionality for a technical answer.
• Give sound notification to the user to ensure the independence and freedom of blind people to make their life simpler and easier.

Project Implementation Method

Our methodology involves embedding of sensors, camera and microcintrollers to stick, belt or glasses programmed in such a way that they will aid the blind person. For microcontroller we will use Arduino and for coding we are going to use python OpenCV. The complete embedded system will work on realtime and can detect obstacles, person as male or female, stairs, holes, fire, wall and puddles as well. The image processing technique will be used to detect stairs. It will also be used to detect the emotions and gestures of the person next to the user. Sensors such as IR sensors, ultrsonic sensors will be used to detects objects , holes and walls. Similarly, sensors like flame sensor, water sensor, temperature sensor will be used to detect fire and water. To communicate with the user, the robot will use vibrations and voice notes. Speakers are to be embedded for sound notifications and buzzers for vibrations.

Benefits of the Project

• This project will provide the benefits of IoT based smart assistive environments combined with robotic systems resulting in a new multi-purpose interaction system: tactile, eye-tracking, voice, and augmented reality control.
• The devices will be easy to carry for daily life assistance.
• It will help the blind to get notified through sound about their surroundings such as fire, stairs, obstacles, holes, puddles coming their way.
• It will let the user know about the expressions and gestures of the person talking to them.
• The system replaces human assistance with a robotic guide of blind. 

Technical Details of Final Deliverable

• The final deliverable comprises of a complete IoT based Robotic System that contains integrated wearables like glasses and belt and a stick for blind people to navigate around easily. 
• The glasses are encorporated with a camera and raspberry pi to detect persons along with their gender, stairs , gestures and emotions by using openCV and through the technique of image processing.
• The navigation belt is used to detect the obstacles  coming in way to the level of waist such as cars while crossing road, wall, hurdles etc by using different kinds of sensors.
• A stick encorporated with various sensors and microcontroller arduino to detect the obstacles, fire, water, puddles and holes.
• The system detects the above mentioned things in a specific distance to the device, gives alerts to the user through vibrator or buzzer and notifies him/her about the object and its type through the speaker.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

Health

Other Industries

Education , IT , Medical

Core Technology

Internet of Things (IoT)

Other Technologies

Artificial Intelligence(AI), Robotics, Wearables and Implantables

Sustainable Development Goals

Good Health and Well-Being for People, Industry, Innovation and Infrastructure, Responsible Consumption and Production

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com