VR LAB

In the recent past, we have observed a pandemic that has changed the dynamics of traditional work ways. Especially education is badly affected by COVID-19 due to which physical classes were shifted to online classes. This protected us from the virus but it affected the learning process, especia

Project Title

VR LAB

Project Area of Specialization

Augmented and Virtual Reality

Project Summary

In the recent past, we have observed a pandemic that has changed the dynamics of traditional work ways. Especially education is badly affected by COVID-19 due to which physical classes were shifted to online classes. This protected us from the virus but it affected the learning process, especially all practical labs. Students have difficulty in understanding and performing labs that use physical equipment which is only present in the lab environment and students are unable to afford to buy all those lab equipment and perform those labs at home. While Instructors are unable to assess student performance and if students were able to understand the topic or not.

In this project we addresses the issue of conducting labs in an online environment and the difficulties and problems that arises due to that. Students are not able interact with tools and equipment present in a physical lab which reduces their learning and understanding. The project provides the solution to this problem by providing a Virtual Reality lab environment where students can interact with tools and equipment so that they can perform the lab. The project uses hand tracking for interacting in the VR environment. The VR lab application is built for mobile devices as it a cost effective platform. Initially VR Lab will contain labs for Workshop practice lab of electrical engineering students such as introduction of basic tools and Soldering.

Project Objectives

Following are the project objectives.

• To create an instructor less immersive VR lab environment so that students feel that they are in the physical lab.
• To create Interaction between tools or equipment and student by accurate hand tracking using motion controller sensors so that they can perform activities / tasks in the VR environment.
• To create real simulations of different tasks so students can perform different activities.
• To create effective guidance system for students so that he can perform activities in an instructor less environment.
• To create a real time feedback system so that students can understand and learn the activities that they are performing.
• To create an accurate assessment system for each lab so that the instructor can assess student performance.

Project Implementation Method

The project will be built on Unity3D as it provides necessary tools to create a VR application. Following are the tools, libraries and hardware required to implement the project.

3D Lab Environment:

The Lab environment will be created on Blender which is a 3D modelling software. Environment lighting will be done in Unity.

VR Library:

We will be using Unity’s Library Mock HMD XR plugin as it provides easy integration and customization. This library creates the VR view for both eyes. For rotational tracking (3D0F) we are using custom script which will be using gyroscope sensor from the mobile device.

Hand Tracking:

The Interactions in VR lab with UI and tools will with Hand tracking, for that we will be using Leap Motion Controller. It provides accurate hand tracking in real time with no delay. Leap motion only works with PC, so we will be using a server application running on a PC that will transmit the Leap Motion data to Android device in a Local Area Network (LAN). Following Figure shows the connectivity of Leap Motion.

Benefits of the Project

Following are the benefits of the project stakeholder wise.

Student:

• Students will be able to perform lab in VR environment which will improve their learning and understanding as compared to lab conducted in an online environment.
• The students will be performing lab in a risk free environment as they will be safe from dangers such as electric shocks, burns from soldering iron etc.
• Students can perform the lab as many times as they want for proper understanding.
• Students can perform lab from anywhere as they do not have to be in a physical lab.

Lab Instructor:

• Instructor time is saved as the VR lab provides an instructor less learning environment.

Organization:

• Avoiding cost as costly lab equipment is being simulated in VR environment.
• It is a cost effective method of conducting labs in VR as the project used Mobile devices for VR.

Technical Details of Final Deliverable

The project will contain following final Deliverable:

VR Lab Application:

The VR lab application will run on an Android Device. The app will be uploaded to Google Play Store. The minimum requirement to run VR Lab is Android version 7 (Nougat).

VR headset with Leap Motion mounted on it:

A simple google cardboard style VR box to put the mobile device in and to mount Leap motion on it.

Server Application for Leap Motion:

Since Leap Motion doesn’t work with Android, it will be connected to a PC via USB cable. PC will be running a server application which will transmit Leap Motion data to Android device running VR Lab using a Local Area Network (LAN). It is necessary that both Android device and PC running the server is in same network in order to send Leap Motion data from PC to Android Device.

FYP Report:

The FYP report will contain 14 chapters that covers the problem, literature review, solution, and detailed documentation and implementation details of the project.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

IT

Other Industries

Education

Core Technology

Augmented & Virtual Reality

Other Technologies

Sustainable Development Goals

Quality Education

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com