Sensor Based System for Gesture Recognition of Autism Disorder

Autism, also called Autism spectrum disorder (ASD) is neurological dis-order which effects the development of communication skills and social interactions in children. People with ASD have restricted interest and repetitive behaviors. ASD hurts the person?s ability to function properly in schoo

Project Title

Sensor Based System for Gesture Recognition of Autism Disorder

Project Area of Specialization

Wearables and Implantable

Project Summary

Autism, also called Autism spectrum disorder (ASD) is neurological dis-order which effects the development of communication skills and social interactions in children. People with ASD have restricted interest and repetitive behaviors. ASD hurts the person?s ability to function properly in school, work, and other areas of life.

In this project, we propose design and implemention of a gesture recognition system for deaf and dumb people that converts the sign language into verbals.  This project will facilitate and improve a communication method between the verbal and nonverbal people. Many researches have been conducted to develop sign to speech translator, most of these are based on image-processing based system. The efficiency of these techniques depends on the image quality, which is significantly affected by the light intensity and situation of the implemented camera (resolution, focusing, alignment). These factors can affect the image quality and thus reduces the sys capability to recognize the gesture. In this project we will develop the following modules 1). Body-worn sensors network platform 2). Communication link between body-worn sensors network and raspberry-pi system-on-chip based processing system. 3) Signal conditioning and features extraction from sensors data to improve processing time and accuracy. 4) Classification models performance comparison for better accuracy achievement. The proposed systems will be aid-on to improve the social life of ASD, make them a good citizen, and assist them in communicating with normal people.

Project Objectives

• Multi sensor fusion platform for ASD children complex sign language recognition
• Communication link for transferring body sensors data to processing system
• Performance comparison of time-domain and frequency domain signal information

extracted for better accuracy and time processing

• Collection of Dataset from ASD children
• Performance comparison of recognition algorithm such as neural networks and deep

convolutional network

• Translating the sign language to normal human understanding language

Project Implementation Method

Benefits of the Project

• Work as bridge for ASD children to communicate with normal people.
• Made speech impaired people independent.
• This project will enable ASD children to work like normal people.
• Remove communication barrier between ASD and normal people.

Technical Details of Final Deliverable

• Motion sensor MPU6050
  • Three-axis accelerometer(X,Y,Z)
  • Three-axis gyroscope(Z,Y,Z)
• Flex Sensors (bend in term of resist)
• Controller that will collect data from sensor and transmitt it wirelessly to the processing part.
• Raspberry-Pi based processing system that will extract various features and analyze and recognze the gesture.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

Health

Other Industries

Education , IT

Core Technology

Wearables and Implantables

Other Technologies

Artificial Intelligence(AI)

Sustainable Development Goals

Good Health and Well-Being for People, Reduced Inequality, Peace and Justice Strong Institutions

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com