Hand Gesture Control Robotic Arm
The rapid technological growth has impacted the human life in numerous ways, especially since the dawn of robotics in the domestic tasks, it has changed how we interact with the environment in perming day to day tasks. Robots not only work with high efficiency, accuracy, and precision, but also, the
2025-06-28 16:32:49 - Adil Khan
Hand Gesture Control Robotic Arm
Project Area of Specialization Internet of ThingsProject SummaryThe rapid technological growth has impacted the human life in numerous ways, especially since the dawn of robotics in the domestic tasks, it has changed how we interact with the environment in perming day to day tasks. Robots not only work with high efficiency, accuracy, and precision, but also, they can perform complex tasks which a human cannot. Robotic arms have many applications in the field of space, military, agriculture, healthcare, and industry. The main motive of our project is to build a cost-effective prototype of a robotic arm that can be controlled by hand gestures using leap motion controller. The working prototype of the proposed project would essentially demonstrate picking and placing the objects. The leap motion controller is an integral part of this project which recognizes elbow, wrist and finger movements and they are then directed wirelessly to the robotic arm to replicate the movements.
Project Objectives“To design an IOT based robotic arm that can be controlled by hand gestures remotely using leap motion controller.”
- To investigate cost-effective components; servo motors, Wi-Fi module, raspberry pi & selection of the base. And to assemble and program the robotic arm.
- To interface the components with Raspberry pi and control the movements of arm using Leap motion sensor.
- To test the prototype in real-time.
- To extract the measured positions and other information about each entity detected in the snapshot from each frame contained by the tracking data of real-time hand gestures.
- The real-time data would then be streamed wirelessly to internet through Laptop.
- The Raspberry Pi connected with internet using wi-fi module will get the real-time data of hand gestures.
- The Raspberry Pi sends respective signals to the servo motors in the robotic arm kit to replicate hand gestures.
- The system would be less complex in comparison to the previous works.
- Simple, interactive, and less costly.
- Raspberry pi used in the system makes it more suitable for real time applications.
This project mainly comprises of leap motion controller and raspberry pi connected to the servos assembled in robotic arm kit. Leap motion controller is used for recognizing the hand gesture movements as it contains two monochromatic IR cameras and three infrared LEDs (Light Emitting Diodes). The LEDs generate a 3D pattern of dots of IR light and cameras were assembled in such a fashion to generate 300 frames per second of reflected data. The leap motion controller provides the real-time tracking data of hand gestures which is streamed wirelessly to the internet through laptop. The raspberry pi is also connected to the internet using Wi-fi module and it sends the respective signals of the hand movements to the servo motors assembled in the robotic arm kit and then the robotic arm will move respectively according to the hand gesture movements.
Final Deliverable of the Project HW/SW integrated systemCore Industry ITOther Industries Medical , Agriculture , Food , Security , Telecommunication Core Technology Internet of Things (IoT)Other Technologies Robotics, Cloud InfrastructureSustainable Development Goals Industry, Innovation and InfrastructureRequired Resources| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 63440 | |||
| Leap Motion Controller | Equipment | 1 | 19200 | 19200 |
| Raspberry Pi 4 Model B | Equipment | 1 | 17500 | 17500 |
| 6 DOF Manipulator Aluminum Robot Arm (hand) with Claw and Base | Equipment | 1 | 6000 | 6000 |
| MG995 High Speed Torque Servo motor | Equipment | 6 | 1000 | 6000 |
| Wi-fi module | Equipment | 1 | 2000 | 2000 |
| Dry Battery 12V-3Amp | Equipment | 1 | 1500 | 1500 |
| DC-DC Buck Converter Step Down Module Power Supply | Equipment | 1 | 1250 | 1250 |
| Learning Robotics using Python (Book) | Miscellaneous | 1 | 5000 | 5000 |
| Data cable for raspberry pi | Miscellaneous | 1 | 500 | 500 |
| Power Cable | Miscellaneous | 1 | 500 | 500 |
| Jumper Connecting Wires | Miscellaneous | 30 | 5 | 150 |
| Printing | Miscellaneous | 3 | 1280 | 3840 |