Virtual STEM

The current education system has become stale and lacks innovation as we have practically had the same education system for decades now. The current system lacks interactivity, so this solution allows children to learn from another perspective which man enable them to learn quicker and better. The p

Project Title

Virtual STEM

Project Area of Specialization

Computer Science

Project Summary

The current education system has become stale and lacks innovation as we have practically had the same education system for decades now. The current system lacks interactivity, so this solution allows children to learn from another perspective which man enable them to learn quicker and better. The project uses depth sensing using sensors to scan the images displayed on the projector and detect objects such as a ball and use such objects as input to perform different activities for the children. 

1. A projector and a structured light sensor are calibrated.
2. The sensor using depth sensing techniques to detect objects in front of the projector and detect where they touch, for example a stream of alphabets is projected on a screen. A kid hits a ball at the screen.
3. Next step is to use the input and according to the activity (a ball hitting alphabets to play its sound) we generate the expected output. For example, we detect which letter is hit, and play an animation and sound accordingly.

Project Objectives

• Exploring the field of photogrammetry and 3D graphics and using it to implement the machine learning algorithms for the construction of 3D scans.
• Expertise in image processing
• Learning real time object detection
• Researching about the problems of modern teaching methods
• Our goal is to develop an application that will be able to scan the image displayed by the depth sensor and use it to detect contact from an object on the screen and then have a corresponding action take place.

Project Implementation Method

1. A projector and a structured light sensor are calibrated.
2. The sensor using depth sensing techniques to detect objects in front of the projector and detect where they touch.
3. Next step is to use the input and according to the activity (a ball hitting alphabets to play its sound) we generate the expected output. 

Benefits of the Project

• Education of children from kindergarten to grade 4.
• Interactive learning, yields more results according to studies
• Due to the ongoing pandemic it is essential to find such innovative ways for education, such methods can help students to cover their syllabus quicker by using such methods and techniques.
• The project can be used in schools as a learning activity
• The project can also be used in homes for home schooling
• It can also be used for educating special children.

Technical Details of Final Deliverable

1. Launch Screen

Once you start the application, the first page that is displayed is the launch menu which gives a prompt that the sensors are calibrated correctly and that everything is ok and the application is ready to start. 

2. Main Menu

This is the main menu of the application; it will show different applications that have been deployed in the system and are ready to use. 

3. Interactive Learning Application

This is the main application that will be installed in the system which displays a stream of letters falling from the projected screen and the user can interact with the screen using a ball and animations will be shown according to the letter the user hits.

We use a projector and a kinect v2 sensor and a PC for all this, as explained before.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

Education

Other Industries

Core Technology

Others

Other Technologies

Sustainable Development Goals

Quality Education

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com