Gestures and IOT based home automation

This project presents a smart home that will use image processing, gesture algorithm, sensor interfacing, and IoT Monitoring of the complete system through the Blynk app. A fixed number of gestures will be detected and used for controlling the appliances. The hardware will be led by a Raspberry Pi M

Project Title

Gestures and IOT based home automation

Project Area of Specialization

Electrical/Electronic Engineering

Project Summary

This project presents a smart home that will use image processing, gesture algorithm, sensor interfacing, and IoT Monitoring of the complete system through the Blynk app. A fixed number of gestures will be detected and used for controlling the appliances. The hardware will be led by a Raspberry Pi Microcontroller that will act as a communication module and will perform the action on the appliance in accordance with the gesture detected. It will also include a “GROCERY REMINDER” system that will be identified by the load sensor and IR sensors. These sensors will notify the number of eggs and other grocery items on the owner’s cell phone. The smart homeowner will be able to monitor the number of remaining grocery items using the mobile app. The smart grocery reminder will allow its users to perform their grocery shopping by staying alert at their ease.

Project Objectives

This project of a Smart Home based on gesture recognition and IOT is inspired by seeing the rapid increase in home automation and Domotics in recent years. Home automation was once a dream but now it is becoming more accessible and with more advances in this field it will eventually become a part of everyone’s daily life.

The main aim of this project is to control the gadgets using hand and finger gestures. Home automation means controlling and using home appliances automatically. By having an automated home, the user can live comfortably and help in saving the environment by keeping a check on the resource utilization and also money management. For High Accuracy, we need to develop a fast algorithm for identifying sets of hand gestures using images. For this, an algorithm based on python is used. It is a tool used for real-time image processing by capturing an image using the camera. The information got by the camera is bolstered as a contribution to software and the microcontroller is utilized to send controlling signs to the gadgets. Another aim of this project is to monitor the number of Grocery items using the internet of things (IoT). We designed a system to measure the load information/weight of any type of kitchen ingredient such as spices, sugar, salt, flour, rice, etc. using a load/weight sensor.

Project Implementation Method

Our system will be gesture-based home automation which has basically a pi camera to capture the hand movement and detect the gesture by using image processing techniques and fast algorithms of media pipe and TensorFlow. We will be using the Raspberry Pi 4 2GB for receiving the signal of gestures being identified and sending it to relays that will be connected to specific home appliances. All the appliances are wirelessly monitored through the Blynk app in real-time. The Other section is a smart kitchen in which we use two ESP32 microcontrollers with a Wi-Fi module that can be used for monitoring the Specific groceries items in the kitchen by using a weight sensor and 6 IR sensors that are connected at the bottom of the Egg tray for detection of numbers of eggs left. All the information will send all the details related to ingredients items to a server of the Blynk mobile application.

This process will design in such a way that when the user leaves the house the details related to groceries are sent to his mobile app as a notification or simply a message. ESP32 is also connected with Raspberry Pi using a Wi-Fi module so the activity of appliances is also monitored through the Internet of Things on mobile applications. The Raspberry Pi in our project will basically, not be connected to the computer it will place anywhere with the help of a battery or 5v adapter. It will basically send the commands to Relays as it receives from the computer when the user performs respective hand gestures. It will also relate to ESP32 microcontroller with Wi-Fi module and sending the status of appliances on a mobile app using IoT for Monitoring purposes.

Benefits of the Project

Digital technologies and home appliances are intersecting and emerging in new and unique ways as problems due to the COVID-19 pandemic arise. The home automation trend is gradually accelerated due to Covid-19 as people have to spend more time at their homes and take preventive measures. Studying, working, and socializing at home are the new norm now. The spread of viruses and infections spreads indoors as much as outdoors. Everyone should maintain a clean, disinfected home and we believe that smart home devices can help us keep ourselves safe and healthy.

This is the Next Level of automation that can be utilized at home as well as in the factories. With this, one can control far sitting equipment just with a hand gesture.

In a noisy environment where voice-command-based control fails a gesture solution can be used.

Grocery Monitoring The smart homeowner will be able to monitor the number of remaining grocery items using the mobile app. The smart grocery reminder will allow its users to perform their grocery shopping by staying alert at their ease. 

Technical Details of Final Deliverable

Our Project consist of two main section one is Home automation using Gesture Recognition and the other is Grocery Monitoring System.

1. The Final Hardware consists of a prototype model in which we controlled 4 appliances using Camera and monitored all the appliances through the app.
2. On the same Prototype Model, we have placed an Egg Remainder tray using a 6 IR sensor that runs in real-time and notifies the owner of the house every time when there is 2 Egg remaining in the tray.
3. The weight sensor machine which we design is placed to monitor the concentration of Rice or sugar and notify the owner when the rice or sugar quantity will be less than a particular weight.
4. RFID Tag is placed on the door and when the owner reads the tag to go outside the lock opens and the same time owner is also notified through the app about the remaining items left in the kitchen. 
5. Implementation of Gesture Recognition home automation using raspberry pi to control appliances in the room.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

Manufacturing

Other Industries

IT

Core Technology

Internet of Things (IoT)

Other Technologies

Artificial Intelligence(AI)

Sustainable Development Goals

Industry, Innovation and Infrastructure

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com