Motion controlled pick and place robot using hand gestures
Robotic vehicle movement and Arm control through hand gestures using Microcontroller is an assistive robot system for user-friendly support, hospital operations, and hazardous environment and to increase the autonomy of physically impaired people. It is a kind of functional replacemen
2025-06-28 16:34:11 - Adil Khan
Motion controlled pick and place robot using hand gestures
Project Area of Specialization RoboticsProject SummaryRobotic vehicle movement and Arm control through hand gestures using Microcontroller is an assistive robot system for user-friendly support, hospital operations, and hazardous environment and to increase the autonomy of physically impaired people. It is a kind of functional replacement hand integrated with the moving vehicle that aids the amputees often suffers from physical difficulties.
The prime aim of this system is to make it feasible to interact with the robot through the recognition of hand gestures for the physically challenged people. This is an electromechanical system in which the robotic arm can be controlled by a simple inertial navigation sensor called accelerometer. The gesture commands measured by the accelerometer are processed by the Microcontroller.
The Microcontroller is used in both the transmitter and receiver circuits, it responds based on the input given through the hand gestures. The signals get transmitted and received by advanced wireless RF communication system.
The robotic vehicle can move in all possible four directions (forward, backward, right and left). The different operations performed by the robotic arm are picking and placing the objects from one location to another. For the controlling of the motor, motor driver IC and Microcontroller is used.
This system provides more natural and convenient ways to express their intentions and interactions with the environment.
Project Objectives- To Develop a hand gesture based robotic vehicle with an end effector to pick and place objects.
- To implement a Project that can carry heavy loads.
- To understand and program the hand gesture.
- To control the displacement of the robotic arm so that the arm can be used to pick and place objects from any source to destination
- They are faster and can get the work done in seconds compared to their human counterparts.
- They are flexible and have the appropriate design.
- They are accurate.
- They increase the safety of the working environment and actually never get tired.
A robotic arm integrated with microcontroller, LCD, DC motors and RF video camera controlled by Internet/LAN connection which is mainly used for patient operation. A proper averaging algorithm is used to reduce the amount of noise coming from the output of the sensors. The Ethernet adapter configured with particular IP address can receive the data from the particular computer. The adapter will send the received data to the microcontroller through serial port. After receiving the data, the microcontroller sends appropriate signals to the DC geared motors to control the robotic arm. This framework is mainly used to cut the skin of the patient using the high-speed blades which is nothing but the robotic arm.
The vehicle movement can be controlled based on the detection of motion of hand and refrains the movement of the vehicle if any obstacle is detected in its path. The user can make the vehicle to move around in all possible four directions by simply moving his hand in the desired directions. So that the user doesn’t need to press any buttons. The gesture commands can be captured by a simple inertial navigation sensor called Accelerometer. This system also includes ultrasonic sensor which can be helpful to prevent the robotic vehicle colliding with any obstacle. The signals from the sensors are forwarded to the microcontroller and encoder circuit. The encoded signal is transmitter through RF transmitter. RF receiver receives the signal and decodes it. Finally the microcontroller gives appropriate signals to the motors to change the movements of the robots. This system can be used in the field of construction, hazardous waste disposal and field survey near borders.
The robotic platform and the robotic arm can be controlled by two separate accelerometers. One accelerometer is mounted on the human hand and another one mounted on the leg of the user capturing its gestures and postures and thus the robotic arm and the platform moves accordingly. The motions performed by the platform are forward, backward, right & left and the operations performed by the robotic arm are pick & place/ drop, raising and lowering the objects. The RF Module is used to transmit the different hand and leg gestures made by the user. The system is also equipped with an IP based camera which can stream real time video wirelessly to any Internet enabled device such as Mobile phone, Laptop, Tablet etc. The biggest advantage of this kind of robotic arm is that it can work in hazardous areas and also in the area which cannot be accessed by the human and also used to implement highly precise medical treatments.
Final Deliverable of the Project Hardware SystemCore Industry HealthOther Industries Manufacturing Core Technology RoboticsOther Technologies Artificial Intelligence(AI)Sustainable Development Goals Good Health and Well-Being for PeopleRequired Resources| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 28400 | |||
| RF transmitter/receiver module | Equipment | 1 | 240 | 240 |
| breadboad | Equipment | 1 | 120 | 120 |
| accelerometer | Equipment | 1 | 400 | 400 |
| servo motors | Equipment | 4 | 2125 | 8500 |
| robotic arm | Equipment | 1 | 8000 | 8000 |
| car body | Equipment | 1 | 8000 | 8000 |
| crystal oscillator | Equipment | 1 | 200 | 200 |
| vero board large | Equipment | 1 | 140 | 140 |
| arduino nano | Equipment | 2 | 400 | 800 |
| h-bridge | Equipment | 1 | 400 | 400 |
| battery and wires | Equipment | 1 | 400 | 400 |
| arduino mega | Equipment | 1 | 1200 | 1200 |