Human Interaction Robot with Medical Instrumentation

Project Title

Human Interaction Robot with Medical Instrumentation

Project Area of Specialization RoboticsProject Summary

Patients are more likely to survive any disease, if the hospital where they are being treated have high nurse to patient ratio. Moreover, the nurse staff is also prone to infectious diseases, toxic substances and radiation. We have built a medical robot that is able to perform tasks of a nurse that are repetitive. The robot can navigate around the hospital, interact with doctors, patients and staff and measure the vitals of the patients. The robot measures the temperature and blood pressure. In addition to that, the robot also records the weight, height, and previous history of the patient during the robot-patient interaction. An Electronic Medical Report (EMR) is generated that is shared with the hospital. The robot asks the patient a set of predetermined questions, whose answers are recorded, processed to extract data to fill EMR and refer the patient to the appropriate doctor. We have used a Kinect sensor to map and navigate through the unknown environment. We are also using the Kinect sensor to record the speech of the patient and process it to interact with the patient and generate the EMR. We are using SLAM algorithm to map the unknown static environment and natural language processing for data extraction from speech of the patient. Our robot has minimized the pre-processing time of patients before their checkup, reduced the probability of the nurse contracting any infection and has simultaneously increased the nurse to patient ratio. Our future research is to increase the functionality of the robot to perform sugar test and draw blood sample from a patient for further testing.

Project Objectives

The hospitals in pakistan are under-staffed. The number of nurses is less than the prescribed standard. The difference can be seen specially in government hospitals where even in the emergency wards the number of nurses and hospital staff is very low, because of which many people loose their lives. Other than this people and critical patients have to wait in large queues as procedure to get themselves or their loved ones admitted. The robot that we are manufacturing would ask the patientss or their guardians a set of predetermined questions about their medical history and symptoms. After this the robot will register the patient, record their medical data in an EMR (Electronic Medical Record) and also guide the patient the way to the lab or emergency room. This will save time and effort of the patients and their guardians as they wont have to spend precious and critical time searching the appropriate labs and emergency rooms with little or no help from the staff as we experience in government hospitals.

It will also save time of nurses and staff as they wont have to do routine repetitive tasks like filling the forms of patients or guiding them or asking them their medical history as it will be recorded in EMR. The nurses will be able to spend more tie in critical tasks and taking care of critical patients.

Moreover, a lot of people that visit the hospital are prone to infectious diseases as they come in contact with the medical staff. The reverse is also true as patients coming to hospitals with minor issues may get seriously affected by viral or bacterial infections as during those times their immunity is low. So, this robot will minimize the interaction between patients and guardians with the hospital staff thereby minimizing and significantly reducing the risk of spreading of viral and bacterial infections.

It will also save time as patients would not have to visit labs to get their vitals measured. The temperature, blood pressure and other important vitals will be already measured automaticall by the robot and recorded in the EMR and shared eith the appropriate doctors and the hospital. This will save time and will also ensure that proper protocol is followed while measuring those vitals as opposed to the current situation in hospitals, especially the government hospitals on which more than 80% of our 230 million population relies on.

Project Implementation Method

• The motion planning algorithm will be implemented using the SLAM algorithm. SLAM stands for simultaneous localization and mapping.
• The Human interaction that involves asking pre determined questions and extracting the required information is accomplished using natural language processing and then applying deep learning to the symptoms obtained to figure out the disease that the patient might have.
• my sql and data base fundamentals will be used to make the data base to store the data(EMR) of patients. 
• The robot base that is made of aluminium will be made by machining and body will be made by the process of carbon fiber manufacturing. A mould of the body will be made and then carbon fiber will be spread onto it and then cobalt and other ingredients will be added to harden the mould. 
• The algorithms will be processed by the raspberry pi that will store the speech in digital form and process it to give the results as well as will process the motion algorithm and give signals to motor for motion.
• The environment will be sensed using the kinect sensor and the speech will also be recorded using kinect.
• All electronic circuits will be simulated on Proteus and then implemented on to PCB fully.
• The robot body and base CAD model has been tested for deformation and toppling using Finite Element methods and ansys.

Benefits of the Project

• This will be the first robot that will be manufactured in pakistan that will be installed in a hospital.
• It will save the time that it takes for patients to do the documentation and registration before they can be admitted
• It will manage to reduce the crowd in hospitals as the processing time will be less. 
• There wont be any need of large queues that are present at the administration desk
• The nurse to patient ratio will increase considerably so that greater number of lives will be saved.
• The exposure to harmful viruses and bacterial infections will be reduced.
• Nurses and staff would have to spend less time in repetitive tasks and so can spend more time with critical patients.
• Documentation will be automatic and hospital records will be digital and so could be shared with all the doctors.
• The disease will be highlighted in considerably less time as records will be digital and AI algorithms can be implemented on digital data to detect diseases.
• Appropriate doctors can then be referred to on the basis of the disease detected and symptoms experienced. 
• The number of patients visiting doctors of the same expertise can be optimized so that any one doctor is not crowded and bears all the burden.

Technical Details of Final Deliverable

• Robot body and base assembled. The human robot would have a kinect sensor that would constitute as the head of the robot.
• Robot will have an LCD on its body to display information while interacting with humans.
• Robot will have a motion planning algorithm that will allow it to navigate in the hospital that is an unknown environment.
• The robot will record speech using the kinect and process it and extract info to fill the EMR.
• The EMR will be stored in  an online database and hospital personnel will be able to accesss it.
• Robot will have an Artificial intelligence algorithm programmed to extract the info from speech and refer patient to appropriate consultant doctor.
• Robot will contain allthe necessary electronic circuitry to allow the mentioned functionality such as  an H-Bridge a power distribution board, sensor board and others
• Robot will have a mechanism to measure the temperature and blood pressure using a sensor store the value in the database corresponding to that patient

Final Deliverable of the Project HW/SW integrated systemCore Industry MedicalOther Industries Health Core Technology RoboticsOther Technologies Artificial Intelligence(AI)Sustainable Development Goals Good Health and Well-Being for People, Industry, Innovation and InfrastructureRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	79600
Raspberry pi 4 with 4GB RAM	Equipment	1	13400	13400
Lithium ion battery cell 24V	Equipment	6	900	5400
24V DC Motor	Equipment	2	5400	10800
Kinect sensor	Equipment	1	6000	6000
Sensors including thermal, ultrasonic, IR	Equipment	1	8000	8000
alumnium and Carbon fiber for robot body	Equipment	1	18000	18000
Android Tablet for robot to display info	Equipment	1	8000	8000
wires, screws, tyres	Miscellaneous	1	5000	5000
printing, transportation and other	Miscellaneous	1	5000	5000