Smart Autism Therapist

Project Title

Smart Autism Therapist

Project Area of Specialization Computer ScienceProject Summary

During the last decade the parents have remained busy in generating sources of income for their children and unfortunately, they have forked over their children to THINGS. The devices, gadgets, screens and modern trends have put a worst impact on the children overall the world. The children are facing many diseases which were not common some years ago. Autism is one of them. There are a smaller number of institutions in Pakistan to deal with these kinds of disease (i.e Clinical assessment /Autism Diagnosis, Recommendation for test and rehabilitation, Parent Training Program, Behavior Therapy, Speech Therapy, hearing problems, mental health) with limited resources. In this pandemic situations (COVID-19) all these institutions are closed and the parents of such effected children are unable to get proper treatment for their children. Most of parents were waiting for a solution of this problem. This project aims to provide a platform to such institutions for their regular practices in these kind of situations. Using this platform all the patients not only can consult the relevant doctors, therapist, examiners or consultants for regular sessions but they can show the progress of their daily practices assigned by the doctors and can get advises.

A system based on a website and a mobile application has been proposed that can integrate both of them and then we will provide this app and website to the doctors, therapist, parents and children. We will collect the data from both therapists and patients over cloud then we will process it using machine learning algorithms to train data and these algorithms will help to take decisions as a results. This project is not only limited to the treatment of Autism, but with few changes this project can be used for any medical fields, health care and also can be used for training purpose.

Project Objectives

1. We have an integrated platform and we are going to build an android application and a website on it and its database will be on cloud.
2. We are going to generate dataset using data gathering.
3. With the help of dataset we are going to train our system using AI algorithms.
4. We are going to generate modules for parents, patients, doctors, consultant and therapist
5. With the help of the project we will be able to connect patients and doctors online and patients will be able to take online sessions for their treatment and this way patient no longer needs to go to the physical institute for cure.

Project Implementation Method

Our project will provide an authenticated artificial intelligence based treatment methodology for autism patients. The main implementation of project's method is described as under;

1. We are going to use android studio and flutter to create mobile application and we will use HTML, CSS, Java script and PHP to create a website and then we will integrate both of them so that a user can use the platform of their own choice.
2. We are going to use videos, images and webcam feed to generate dataset and these datasets will help us to train our model and with the help of this model we will be able to track the movement of the patient to analyze the performance of a patient so that a doctor, therapist or examiner can understand the progress of the patient and proceed with the treatment accordingly.
3. We are going to use OpenCV for object detection to train our systems with maximum accuracy. We will use AI algorithms for background subtraction and with the help of background subtraction we will be able to train our model for training our system to analyze Human posture.
4. With the help of modules parents can keep track of their child progress and doctors will be able to assign tasks for the treatment of the patients and the user can also give feedback about the treatment of the doctor.
5. We are going to use convolutional neural network (CNN), AlexNet, ResNet and GoogLeNet to train our model and with the help of these algorithms better and more validated results are achieved which are backed by the latest machine learning methodologies and we will be able to get decisions and desired results, this will be very helpful for the doctor, therapist or examiner to treat the patient more effectively, and thus our system will be comparatively more authenticated for the treatment.

Benefits of the Project

By using this platform all the patients not only can consult the relevant doctors, therapist, examiners or consultants for regular sessions but they can show the progress of their daily practices assigned by the doctors and can get advises. Our project will cover the following treatment methodologies;

• Video demostration
• Patient's treatment history
• Live sessions availability on app
• Integrated system with backend APIs
• Regular reports of treatment sessions & 
• Feedback system to maintain and imporve app's performance

Technical Details of Final Deliverable

The aim of proposing this project is to tackle the issue that most of the children with Autism disease are facing problems to get the treatment during COVID-19 as the children are not able to attend the session and the consultant and doctors are also not available to resolve the problems of the children under their investigation. The patients who are facing Autism, Behavior problems, Speech problems, hearing problems, mental health, Rhett syndrome, childhood disintegrative disorder (CDD), Kanner’s syndrome and pervasive development disorder (PDD) were left behind because there was no platform which can used to solve this problem.

Our project main deliverables will cover all the issues as mentioned above during the proceeding achievement of milestones. These milestones are as follows;

Requirement Gathering:

• During this phase, the team will gather all the functional & non-funtional requirements of the treatment along with the application requirements as needed during treatment from therapist as well as patient's perspectives.
• Deliverables of this phase will include the refined functional and non-functional requirements of this app that will help to proceed to next phase.

Research & Analysis:

• During this phase, the team will conduct a comprehensive research study and finalize the feasibility of the requirements that were Gathered in last phase.
• Deliverable: Feasible refined requirements

Designing:

• Project's wireframing, UI/UX designing along with technical diagrams like DFD, ERD, activity, etc. will be created.
• Deliverable: UI/UX Design of App with tchnical Diagrams

Developemnt of Autism Application:

• Application will be developed for Android, iOS on flutter, and  project's website.
  • AI based video analysis model
  • Reports
  • History & Feedback
• Deliverable: Autism Treatment Application

Testing:

• Black box and white box testing of the app.
• Deliverable: Testing results & Bugs fixes

Technical Documentation:

• Project's detailed report covering all the technical, non-technical aspects.
• Deliverable: Project's Technical Report

Deployment :

• Application and web app's deployment to the live environments.
• Deliverable: Live apps on Android, iOS and web domains

Final Deliverable of the Project HW/SW integrated systemCore Industry ITOther Industries Medical , Health Core Technology Artificial Intelligence(AI)Other Technologies Cloud InfrastructureSustainable Development Goals Good Health and Well-Being for PeopleRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	79000
Nikon D5300 18-55mm AF-P VR	Equipment	1	69000	69000
Android app (Google Playstore Developer Account Registration Fee)	Miscellaneous	1	4000	4000
Web Domain Costing	Miscellaneous	1	6000	6000