Controlling Computer Applications using Hand Gesture
Hand gesture control can be used in virtual reality applications. Augmented reality is the boom nowadays and hand gesture can play an important role. Human Machine Interface or HMI is a system comprising of hardware and software that helps in communication and exchange of informa
2025-06-28 16:25:59 - Adil Khan
Controlling Computer Applications using Hand Gesture
Project Area of Specialization Artificial IntelligenceProject SummaryHand gesture control can be used in virtual reality applications. Augmented reality is the boom nowadays and hand gesture can play an important role. Human Machine Interface or HMI is a system comprising of hardware and software that helps in communication and exchange of
information between the user (human operator) and the machine. Instead of using a keyboard, mouse or joystick, we can use our hand gestures to control certain functions of a computer like play/pause a video, move left/right in a photo slide show, scroll up/down in a web page and many more. In this project, have implemented a simple Arduino
based hand gesture control system controldifferentcomputer applications. Using Arduino, Ultrasonic Sensors and Python as able to control computer with hand gestures. The Ultrasonic Sensors are used to detect the distance of the hands from the sensors or in effect Computer screen since the sensors are mounted on top of the monitor. The ultrasonic sensors have a Transmitter and a Receiver. The transmitter transmitsultrasonic waves and the Receiver receives The waves after they are reflected back from an encountered obstacle in the path of the wave. The obstacles for our purpose are hands. The Arduino Uno board runs the program used to calculate the distance between the sensors and the hands. The program uses these distances to perform the defined operations.
Objectives of the Project
The desktop computing paradigm limits the users' flexibility by forcing them to interact using a-Degree-Of-Freedom device (the mouse), while they are used to interacting with the physicalworld in much more differentiated ways .Gestures allow the user to handle multiple points of inputand even define several parameters at once. They are, therefore, a more natural form ofcommunication. Compared to many existing interfaces, hand gestures have the advantages ofbeing easy to use, natural, and intuitive. It reduces the complexity of interaction. Limit use of hardreturns to only one return at the end of a paragraph. Do not add any kind of pagination anywherein the paper. Keeping in view the major problems faced by traditional human-computer interaction methods, the main objective ofthis project is to control the system by hand gestures. By using this technology, we make ourmechanical computer into a natural gesture-controlled computer.This project make it possible for you to just put your handd yo controll pC
Project Implementation MethodSystem Development and Implementation
The primary objectives of the development are to translate the most promising design approachinto a stable, interoperable, producible, and cost effective design, validate the manufacturing orproduction process and demonstrate system capability through testing.n this project, the component identified in the form of hardware and software, these componentsare encoded by Python and C++ and after encoding them, by the combination of both hardwareand software, it recognized hand gestures and performs specific operations according to themeasured gestures.Now coming toward the placement of the gadgets, place both sensors on the top of the laptop,one of the left tops of the laptop and the second one is on the other top corner of the laptop.Attach the Arduino Uno to the back of your laptop screen. Connect theArduino with the laptop byusing the USB cable and connect the sensors with the laptop with Arduino with the jumper wires.To make hardware operate able, firstly the code of C++ is written in the Arduino IDE to measurethe distance between sensor and laptop screen. After the completion of the code it is uploaded onthe Arduino UNO.On the other hand, Python code written on PyCharm is used to capture the input that generated bythe Arduino code and set the operation on these inputs. The Python code is executed once thehardware setup completely done. Then the output appears on the PyCharmIt is showing the description of operation such as window down, up, next, previous, close folder,enter folder and exit etc.
Benefits of the Projecthand gestures have the advantages ofbeing easy to use, natural, and intuitive. It reduces the complexity of interaction. Limit use of hardreturns to only one return at the end of a paragraph. Do not add any kind of pagination anywhere the paper. Do not number text heads-the template will do that for you. Keeping in view themajor problems faced by traditional human-computer interaction methods, the main objective of this project is to control the system by hand gestures. By using this technology, we make ourmechanical computer into a natural gesture-controlled computer.This project make it possible for you to just put your hand in front of the sensors then to performa specific task which you desire. The operations changed when you take your hand far from thesensor or take your hand close to the sensor then it performs different operations.
Technical Details of Final DeliverableLatest Technology
Nowadays, generation includes both hardware and software, which together make up an entirecomputer system. Fifth-generation computing devices, based on artificial intelligence, are still indevelopment, though there are some applications, such as voice recognition and gesture controlhat are being used today. The use of parallel processing andsuperconductors is helping to maker Atificial intelligence a reality.Quantum computation and molecular and nanotechnology will radically change the face of computers in years to come. The goal of fifth-generation computing is to develop devices that respond to natural language input and are capable of learning and self-organization.
System Requirements
After the detailed analysis of exiting systems, following software and hardware requirements havebeen perceived:Software Requirement:
• The project Arduino based Hand Gesture Control of Computer is need to be implemented
using Python because of its powerful features.
• Python and pySerial (library for communicating with serial ports).
• To perform actions on our computer we will need Python pyautogui library.
• A python program for to establish a serial communication with Arduino through the correct rate and then perform some basic keyboard actions. The first step with python wouldbe to install the pyautogui module.
Final Deliverable of the Project HW/SW integrated systemCore Industry ITOther Industries IT Core Technology Artificial Intelligence(AI)Other TechnologiesSustainable Development Goals Industry, Innovation and InfrastructureRequired Resources| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 13600 | |||
| Arduino sensor | Equipment | 3 | 2000 | 6000 |
| Ultrasonic Sensors | Equipment | 2 | 2000 | 4000 |
| USB Cable (for Arduino) Connecting Wires | Equipment | 3 | 1200 | 3600 |