Augmented Reality Based Simulated Interactive Display for Scientific Education

Project Title

Augmented Reality Based Simulated Interactive Display for Scientific Education

Project Area of Specialization Augmented and Virtual RealityProject Summary

The modern advancement in technology has changed the approach to solve problems in many fields of life. However, there is little or no effort to introduce latest technology in education sector. The learning process is still traditional and it is unable to produce desired results. It is high time to use cutting edge technology for the learning process in the class rooms. We need to get our young generation ready by training them through latest methods and quickly growing breakthrough technologies (technologies that will have a profound effect on our lives). Keeping this observation in mind, we are proposing to develop augmented reality based interactive display system for demonstrating the concepts of Physics in a friendly and fun way. Our proposed system contains a projector, sensor, processor and customized algorithm. The proposed system is portable, hence, we can take it to remote areas of the country where there are no science laboratories. Any floor or wall can turn into interactive display (a science laboratory) to visualize the demonstration of concepts of physics. Initially, we simulate two experiments of physics using unity 3D software to show the effectiveness of the proposed system. First experiment shows the generation of new particles after collision of accelerated particles (protons). This experiment is named as proton football. The second experiment is to show effect of Higgs field on mass of the object. In next phase, this system can be extended to demonstrate any experiment in through interaction. The cost of this system is much less than amount required for establishing the science laboratory. Also impact of the proposed system can be huge if we use this system for demonstration in schools, science exhibitions, and science fair, public parks and even in shopping centers.

Project Objectives

The main objectives/milestones that we are going to achieve in the lifespan of this project are as follows:

1. Designing augmented reality based interactive display systems in class rooms to create easiness and fun in learning process
2. Developing the simulation algorithms for experiments of physics using unity 3D software
3. Interfacing the developed algorithms in unity 3D with Kinect sensor to create the interactive display
4. Using edge blending technology to make interactive displays using multiple projectors
5. Developing user friendly graphical templates for interactive display using C# language, adobe Photoshop, adobe premiere pro and visual studios

Project Implementation Method

This projected is implemented by using following software and hardware: 

1. Unity 3D software
2. Windows Kinect V2 Sensor
3. Projectors
4. Adobe Photoshop
5. Premier pro software

1. Firstly, we develop the model for Proton Football using particle effects, box collider, and speed magnitude libraries of Unity 3D software.

2. The proton football model will be created using the game objects provided by unity. We will use two particle systems from unity 3D to create two Spheres as footballs and five cubes with boundary lines as football field. Finally, logic will be created such that when football would collide with the other football, the particle system would be activated and it will emit particles depending upon the speed of the colliding footballs.

3. Afterwards, graphics to the footballs, base and the boundary lines will be added to make it more attractive using adobe Photoshop and premier pro.

4. Then, we simulate the effects of Higgs field using depth sensor (for human body tracking and outlining) and skeleton tracking mechanisms with help of Kinect sensor and unity 3D.

5. For showing the effect of Higgs field, two screen are created. One screen shows the effect of Higgs field on human body, and second screen shows the human body without Higgs field. This Field is created by an array of particles (spheres) that will move towards human body if it is in the range of field.

6. After that, for making developed algorithms interactive we use the Kinect Sensor. Kinect sensor cannot directly interact with the Unity Software, therefore, we have to install the Kinect SDK that allow us to connect with unit 3D and use its built-in libraries.

7.  Next, we will use the built-in libraries of unity 3D to make the skeleton joints visible and apply mass to them so that they can interact with objects.

Benefits of the Project

The advantages/benefits of these applications are:

1. The learning process in class rooms become fun through interactive displays.
2. The proposed system is portable. Hence, the demonstrations can be visualized anywhere and anytime.
3. The proposed system does not occupy any space (like tradition science laboratories). Hence, any wall or floor can be converted into interactive science demonstration.
4. The proposed system save the cost of space and components required for establishing the science experiments.
5. The proposed system will have high positive impact on the students’ in terms of learning the important concepts of science due to its interactive and visualizing nature.  
6. The proposed system is highly scalable to other sectors also like marketing, entertainment etc.

Technical Details of Final Deliverable

Following are the Technical Details of Final Deliverable:

1. We will develop a modern way of delivering education through a system based on cutting edge technology. Learning will be fun and convenient through interactive experiences.  
2. This project will deliver two customized algorithms on Unity 3D software. Also the hardware will be developed which consists of implementation of developed algorithms through Kinect Sensor and projector.
3. First algorithm is for particle acceleration, particle collision and particle generation. Generally, it is known as Proton Football. In this algorithm, students will visualize the demonstration about interaction of proton particles with each other when accelerated at a higher velocity and their effect after collision. This will also show that how LHC (Large Hadron Collider) tunnel works.
4. Second algorithm will simulate the Higgs Field. In this algorithm, students will visualize how a mass-less particle (quantized Higgs boson particle) will interact with or without the presence of Higgs Field. If Higgs Field is present, the body will accumulate mass continuously while it would not acquire any mass without Higgs Field.
5. Finally we will provide a finished portable product in the firm of tunnel.

Final Deliverable of the Project HW/SW integrated systemCore Industry EducationOther Industries Media Core Technology Augmented & Virtual RealityOther TechnologiesSustainable Development Goals Quality EducationRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	79950
Optoma HD Multimedia Projectors	Equipment	50000	1	50000
Kinect V2	Equipment	11500	1	11500
Xbox Kinect Adapter for Xbox One S and Windows 10 PC	Equipment	8500	1	8500
2ft Projector Ceiling Mount - Material : Iron (Square Type) - CZCM2fMS	Miscellaneous	4500	1	4500
HDMI Cable 15 Meter Flat 1.4 V	Miscellaneous	1750	1	1750
Panasonic Power Cable Cord 3 pin 15 Meter	Miscellaneous	2250	1	2250
USB 2.0 extension cable 15M Male to Female Active Extension Extender C	Miscellaneous	1450	1	1450