PANDDEM Pandemic Avoidance with Neural Decision Making using Electronic Mirror

While brushing teeth, admiring our beautiful visage in the morning, or whether we are getting ready for work and even for a night out with friends, a mirror is an important object which we use everyday. With the IOT devices being more and more ubiquitous, the modern smart home needs a hub ? so why n

Project Title

PANDDEM Pandemic Avoidance with Neural Decision Making using Electronic Mirror

Project Area of Specialization

Artificial Intelligence

Project Summary

While brushing teeth, admiring our beautiful visage in the morning, or whether we are getting ready for work and even for a night out with friends, a mirror is an important object which we use everyday. With the IOT devices being more and more ubiquitous, the modern smart home needs a hub — so why not make a mirror into a personal assistant which can show more than just your reflection. Customized music or news articles after facial recognition, COVID case count etc.

The smart mirror facilitates access to personalized services and has central control in your homes/offices/malls environment. We can further progress this project by implementing services for the users that will make use of Machine Learning like learning user behavior and helping them do more.

Project Objectives

• To implement a fully capable display and integrating it with a mirror in a seamless way. Mirror and display would act as one.
•  To apply gesture detection for easy interfacing and hands-free navigation which is also CoVid friendly across our UX/UI. The UX/UI would not mimic any current OS interface but would rather perfectly integrate with the mirror to provide a consistent experience.
• To apply facial recognition for biometric security and user privacy.
• To display notifications, news, weather and daily routine information on the mirror specific to each user.
•  To apply CoVid related functionalities like mask remainder, total cases count, CoVid and hand washing timer application.
•  To install a system to detect when a person is standing in front of the mirror to enable the device to smartly activate without active invocation.

Project Implementation Method

In order to fully understand the concept of Smart Mirror, we first need to grasp the methodology behind it. So, in this section we will provide all the relevant steps and details that are essential in order to initiate our project. We will be giving an overview of all the important things mentioned below so that a foundation of what we are trying to engage with can be pictured:

1.  The construction of Smart Mirror
2. Initial workings on raspberry pi
3. Setting up Microsoft Kinect with the system

I. The Construction of Smart Mirror

First of all, the frame for the mirror will be constructed in such a way that our mirror and the led screen through which all the information will be displayed can be placed upon the frame. After placing the mirror carefully, the led screen will be placed in the appropriate position. Along with that, all the other peripherals such as Raspberry Pi, microphone (optional), and the respective connection with led screen will be established. Some heat syncs will also be attached to the Raspberry Pi in order to minimize the heat dissipation. Once all the things are in place. A cover will be placed on the back of the frame in order to secure and hide all the peripherals inside it. Note that, we will place the Raspberry Pi inside the frame after we have done our processing on it. The layering of the components will look something like this;

II. Initial Workings on Raspberry Pi

Now firstly we will have to boot our Pi with the correct OS before working on it, and the appropriate OS can be downloaded from their own website https://www.raspberrypi.org/downloads/ Which also has all the instructions on how to download and install the OS on a SD Card and plug that card into your Raspberry Pi. As of right now, we just want to see if everything works swiftly, so we will try to display some textual information on a black background or we will use some open source code to do the same thing.

III. Setting up Microsoft Kinect with the system

Microsoft provide ways to integrate Kinect technology with other peripherals for 3d modelling, motion detection and much more. So we will be integrating the Kinect with our system in order to fetch data that is relevant for us to do our post processing functionalities.

Benefits of the Project

The main focus of our project is accessibility and convenience, which is why its applications are limitless. Its direct customers can be any type of consumers due to its functionalities wrapped around the ideology of IoT which makes it able to be used anywhere like in houses, in offices, supermarkets, etc. Its beneficiaries can be companies such as Huawei which immensely works on their very own IoT based eco-system technology in order to keep everything connected. Smart Mirror has already many consumer-based functionalities, but it also be used as a hub to control other peripherals; whether they are in-house appliances or something that is virtually not in the vicinity of the consumer

Technical Details of Final Deliverable

The expected outcome should be a smart mirror that integrates seamlessly into the living space while also providing rich information, interactivity and user privacy through biometrics. The technical details of the final deliverable are highlighted through the image attached:

Final Deliverable of the Project

HW/SW integrated system

Core Industry

IT

Other Industries

Medical , Health , Security

Core Technology

Artificial Intelligence(AI)

Other Technologies

Internet of Things (IoT), Augmented & Virtual Reality

Sustainable Development Goals

Good Health and Well-Being for People, Partnerships to achieve the Goal

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com