Hand Gesture Control Robotic Arm

The rapid technological growth has impacted the human life in numerous ways, especially since the dawn of robotics in the domestic tasks, it has changed how we interact with the environment in perming day to day tasks. Robots not only work with high efficiency, accuracy, and precision, but also, the

Project Title

Hand Gesture Control Robotic Arm

Project Area of Specialization

Internet of Things

Project Summary

The rapid technological growth has impacted the human life in numerous ways, especially since the dawn of robotics in the domestic tasks, it has changed how we interact with the environment in perming day to day tasks. Robots not only work with high efficiency, accuracy, and precision, but also, they can perform complex tasks which a human cannot. Robotic arms have many applications in the field of space, military, agriculture, healthcare, and industry. The main motive of our project is to build a cost-effective prototype of a robotic arm that can be controlled by hand gestures using leap motion controller. The working prototype of the proposed project would essentially demonstrate picking and placing the objects. The leap motion controller is an integral part of this project which recognizes elbow, wrist and finger movements and they are then directed wirelessly to the robotic arm to replicate the movements.

Project Objectives

“To design an IOT based robotic arm that can be controlled by hand gestures remotely using leap motion controller.”

1. To investigate cost-effective components; servo motors, Wi-Fi module, raspberry pi & selection of the base. And to assemble and program the robotic arm.
2. To interface the components with Raspberry pi and control the movements of arm using Leap motion sensor.
3. To test the prototype in real-time.

Project Implementation Method

1. To extract the measured positions and other information about each entity detected in the snapshot from each frame contained by the tracking data of real-time hand gestures.
2. The real-time data would then be streamed wirelessly to internet through Laptop.
3. The Raspberry Pi connected with internet using wi-fi module will get the real-time data of hand gestures.
4. The Raspberry Pi sends respective signals to the servo motors in the robotic arm kit to replicate hand gestures.

Benefits of the Project

• The system would be less complex in comparison to the previous works.
• Simple, interactive, and less costly.
• Raspberry pi used in the system makes it more suitable for real time applications.

Technical Details of Final Deliverable

This project mainly comprises of leap motion controller and raspberry pi connected to the servos assembled in robotic arm kit. Leap motion controller is used for recognizing the hand gesture movements as it contains two monochromatic IR cameras and three infrared LEDs (Light Emitting Diodes). The LEDs generate a 3D pattern of dots of IR light and cameras were assembled in such a fashion to generate 300 frames per second of reflected data. The leap motion controller provides the real-time tracking data of hand gestures which is streamed wirelessly to the internet through laptop. The raspberry pi is also connected to the internet using Wi-fi module and it sends the respective signals of the hand movements to the servo motors assembled in the robotic arm kit and then the robotic arm will move respectively according to the hand gesture movements.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

IT

Other Industries

Medical , Agriculture , Food , Security , Telecommunication

Core Technology

Internet of Things (IoT)

Other Technologies

Robotics, Cloud Infrastructure

Sustainable Development Goals

Industry, Innovation and Infrastructure

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com