Gesture hand control robot
Abstract: The goal of gesture recognition in Computer Science field has always been the minimization of the distance between the physical world and the digital world.A Robot is an electro-mechanical system that is operated by a computer program. Robots can be autonomous or semi-autonomous. A
2025-06-28 16:32:45 - Adil Khan
Gesture hand control robot
Project Area of Specialization RoboticsProject SummaryAbstract:
The goal of gesture recognition in Computer Science field has always been the minimization of the distance between the physical world and the digital world.A Robot is an electro-mechanical system that is operated by a computer program. Robots can be autonomous or semi-autonomous. An autonomous robot is not controlled by human and acts on its own decision by sensing its environment.Some of the most commonly used control systems are voice recognition, tactile or touch controlled and motion controlled.
One of the frequently implemented motion controlled robot is a Hand Gesture Controlled Robot. In this project, a hand gesture controlled robot is developed using MPU6050, which is a 3-axis Accelerometer and 3-axis Gyroscope sensor and the controller part is Arduino Nano.
.The project is based on wireless communication where the data from the hand gestures is transmitted to the robot over RF link (RF Transmitter – Receiver pair).
The project is divided into transmitter and receiver section.
TTo understand the principle of operation of Hand Gesture Controlled Robot, let us divide the project into three parts.
The first part is getting data from the MPU6050 Accelerometer Gyro Sensor by the Arduino. The Arduino continuously acquires data from the MPU6050 and based on the predefined parameters, it sends a data to the RF Transmitter.
The second part of the project is the Wireless Communication between the RF Transmitter and RF Receiver. The RF Transmitter, upon receiving data from Arduino (through the Encoder IC), transmits it through the RF Communication to the RF Receiver.
Finally, the third part of the project is decoding the Data received by the RF Receiver and sending appropriate signals to the Motor Driver IC, which will activate the Wheel Motors of the Robot.
Project Objectives The main goal of this project is to control the movement of the robot with hand gesture using accelerometer. The purpose of our project is instead of using a remote control with buttons or a joystick, the gestures of the hand are used to control the motion of the robot. Project Implementation Method
Transmitter Section
The transmitter section of the robot consists of Arduino Nano board, MPU6050 Sensor, HT-12E Encoder IC and an RF Transmitter. The communication between Arduino and MPU6050 Sensor takes place through I2C Interface. Hence, the SCL and SDA pins of the MPU6050 Sensor are connected to A5 and A4 pins of the Arduino Nano.
Additionally, we will be using the interrupt pin of the MPU6050 and hence, it is connected to D2 of Arduino Nano.
HT-12E is an encoder IC that is often associated with RF Transmitter module. It converts the 12-bit parallel data to serial data. The 12-bit data is divided into address and data bits. A0 to A7 (Pin 1 to Pin8) are the address bits and they are used for secure transmission of the data. These pins can be either left open or connected to ground (Vss). In this circuit, Pin 1 to Pin 9 (A0 – A7 and Vss) of HT-12E are connected to ground.
Receiver Section
The receiver section of the robot consists of an RF Receiver, HT-12D Decoder IC, L293D Motor Driver IC and a robot chassis with four motors connected to wheels.
HT-12D is the decoder IC that is often associated with RF Receiver. It converts the serial data received by the RF link into parallel data. A0 to A7 (Pin 1 to Pin 8) are the address pins and must be matched with the address pins of the encoder.
Since the address pins of encoder (HT-12E) are grounded, the address pins of decoder must also be grounded. Hence, pins 1 to 9 (A0 – A7 and Vss) are connected to ground. The serial data from the RF Receiver is given to Din (Pin 14) of the decoder IC.
HT-12D has an internal oscillator and an external resistor of 33K? is connected between OSC1 and OSC2 (Pins 16 and 15). Pin 17 (VT) indicates a valid transmission of data and this pin will be high when a valid data is present on the data pins. An LED in series with a 330? resistor is connected to this pin to indicate a valid data transmission.
In this project, a mobile robot that is controlled by the gestures made by the hand, is designed.
the gesture controlled robot is a wireless operated robot and has two parts: Transmitter and Receiver. When the robot is powered on, the transmitter part, which consists of Arduino, MPU6050, Encoder and RF Transmitter, will continuously monitor the MPU6050 sensor.
This data is captured by the Arduino, which then transmits a corresponding data to the Encoder, based on the orientation of the MPU6050 Sensor. The parallel data received by the encoder is converted into serial data and this serial data is transmitted by the RF Transmitter.
At the receiver section, the RF Receiver receives the serial data and transmits it to the Decoder IC. The Decoder will convert the serial data to parallel data and this parallel data is given to the motor driver IC. Based on the data, the movement of the motors, and hence the movement of the robot is defined.
Benefits of the Project Applications-
Wireless controlled robots are very useful in many applications like remote surveillance, military etc.
-
Hand gesture controlled robot can be used by physically challenged in wheelchairs.
-
Hand gesture controlled industrial grade robotic arms can be developed.
- These robotics are used in industries to control trolly and lift.
- These robotics are used in the construction field.
Transmitter Block Diagram
Receiver Block Diagram
| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 69600 | |||
| Arduino Nano | Equipment | 1 | 3000 | 3000 |
| 34MHz RF Transmitter | Equipment | 1 | 2500 | 2500 |
| HT-12E Encoder IC | Equipment | 2 | 3000 | 6000 |
| MPU6050 Accelerometer/Gyroscope Sensor | Equipment | 2 | 4000 | 8000 |
| 750K? Resistor | Equipment | 2 | 1000 | 2000 |
| L293D Motor Driver IC | Equipment | 1 | 10000 | 10000 |
| HT-12D Decoder IC | Equipment | 3 | 2500 | 7500 |
| 434 MHz RF Receiver | Equipment | 2 | 2550 | 5100 |
| 33K? Resistorv | Equipment | 4 | 1000 | 4000 |
| 330? Resistor | Equipment | 3 | 1000 | 3000 |
| LED | Equipment | 5 | 700 | 3500 |
| 4 Geared Motors with Wheels | Equipment | 1 | 10000 | 10000 |
| Robot Chassis | Equipment | 1 | 5000 | 5000 |