Development of proof of concept for helmet mounted cueing system for flight simulator

Project Title

Development of proof of concept for helmet mounted cueing system for flight simulator

Project Area of Specialization Wearables and ImplantableProject Summary

The aim of this project is to develop a proof of concept for helmet mounted cueing system. This includes integration of glasses with embedded sensors to detect eyeball movements of the pilot and lock targets on screen of the flight simulator and to develop a pilot’s head position monitoring to operate a flight simulator.

Project Objectives

Following are the tasks to be performed in this project:

(1) Tracking the eyeball movement of the subject to lock different targets on a flight simulator.

(2) Tracking the head motion of the subject to change the viewing angle in the simulator.

Project Implementation Method

(1) The head motion data is transferred from the sensor to arduino.

(2) A connection from MATLAB to flight simulator is established using Simulink.

(3) Data from webcam and IMU is transferred to the flight simulator using MATLAB to control it.

Benefits of the Project

Advancements in technologies have significantly increased the prices of new aircraft. Commercial vendors are spending millions of dollars for the training of their pilots. The proposed project will offer a low-cost training solution, where the pilots and ground operators will be able to familiarize themselves with Helmet Mounted Cueing System (HMCS). Integration of actual sensors and associated hardware will give a real mission feel to the operator. Moreover, the eyeball and head movements of professional pilots can be noted and used to groom novice pilots and operators.

Technical Details of Final Deliverable

A custom-built headgear integrated with webcam/IR sensor and IMU connected with arduino. The headgear will be supplemented with dedicated software to translate the sensed data and human (operator's) head and eyeball movements into measurable actions by integrating it with a commercially available flight simulator. For experimentation purpose, XPlane flight simulator has been shortlisted which will be integrated through MATLAB.

Final Deliverable of the Project HW/SW integrated systemType of Industry IT Technologies Wearables and ImplantablesSustainable Development Goals Industry, Innovation and InfrastructureRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	80000
MPU-9250	Equipment	1	4000	4000
Arduino pro micro	Equipment	1	5000	5000
QTR-1A reflectance sensor	Equipment	2	3000	6000
Simulation Station	Equipment	1	45000	45000
Logitech Camera	Equipment	1	10000	10000
Field Visits	Miscellaneous	2	5000	10000