Virtual STEM
The current education system has become stale and lacks innovation as we have practically had the same education system for decades now. The current system lacks interactivity, so this solution allows children to learn from another perspective which man enable them to learn quicker and better. The p
2025-06-28 16:36:38 - Adil Khan
Virtual STEM
Project Area of Specialization Computer ScienceProject SummaryThe current education system has become stale and lacks innovation as we have practically had the same education system for decades now. The current system lacks interactivity, so this solution allows children to learn from another perspective which man enable them to learn quicker and better. The project uses depth sensing using sensors to scan the images displayed on the projector and detect objects such as a ball and use such objects as input to perform different activities for the children.
- A projector and a structured light sensor are calibrated.
- The sensor using depth sensing techniques to detect objects in front of the projector and detect where they touch, for example a stream of alphabets is projected on a screen. A kid hits a ball at the screen.
- Next step is to use the input and according to the activity (a ball hitting alphabets to play its sound) we generate the expected output. For example, we detect which letter is hit, and play an animation and sound accordingly.
- Exploring the field of photogrammetry and 3D graphics and using it to implement the machine learning algorithms for the construction of 3D scans.
- Expertise in image processing
- Learning real time object detection
- Researching about the problems of modern teaching methods
- Our goal is to develop an application that will be able to scan the image displayed by the depth sensor and use it to detect contact from an object on the screen and then have a corresponding action take place.
- A projector and a structured light sensor are calibrated.
- The sensor using depth sensing techniques to detect objects in front of the projector and detect where they touch.
- Next step is to use the input and according to the activity (a ball hitting alphabets to play its sound) we generate the expected output.
- Education of children from kindergarten to grade 4.
- Interactive learning, yields more results according to studies
- Due to the ongoing pandemic it is essential to find such innovative ways for education, such methods can help students to cover their syllabus quicker by using such methods and techniques.
- The project can be used in schools as a learning activity
- The project can also be used in homes for home schooling
- It can also be used for educating special children.
- Launch Screen
Once you start the application, the first page that is displayed is the launch menu which gives a prompt that the sensors are calibrated correctly and that everything is ok and the application is ready to start.
2. Main Menu
This is the main menu of the application; it will show different applications that have been deployed in the system and are ready to use.
3. Interactive Learning Application
This is the main application that will be installed in the system which displays a stream of letters falling from the projected screen and the user can interact with the screen using a ball and animations will be shown according to the letter the user hits.
We use a projector and a kinect v2 sensor and a PC for all this, as explained before.
Final Deliverable of the Project HW/SW integrated systemCore Industry EducationOther IndustriesCore Technology OthersOther TechnologiesSustainable Development Goals Quality EducationRequired Resources| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 30000 | |||
| Projector | Equipment | 1 | 15000 | 15000 |
| Kinect v2 Sensor | Equipment | 1 | 10000 | 10000 |
| Screen | Equipment | 1 | 5000 | 5000 |