Gesture controlled robotic gripper arm using kinect sensor
Robotics is becoming one of the most advanced branches in the field of technology. A Robot is an electro-mechanical system that is operated by a computer program. Robots can be autonomous or semi-autonomous. An autonomous robot acts on its own decision by sensing its environment. These mostly have i
2025-06-28 16:27:28 - Adil Khan
Gesture controlled robotic gripper arm using kinect sensor
Project Area of Specialization Electrical/Electronic EngineeringProject SummaryRobotics is becoming one of the most advanced branches in the field of technology. A Robot is an electro-mechanical system that is operated by a computer program. Robots can be autonomous or semi-autonomous. An autonomous robot acts on its own decision by sensing its environment. These mostly have industrial use considering their high speed and accuracy. But some applications require semi-autonomous or human controlled robots.Some of the most commonly used control systems are voice recognition, tactile or touch controlled and motion controlled.
A Gesture Controlled robotics a kind of robot which can be controlled by one’s hand gestures instead of conventional buttons. These kinds of robots generally have a transmitting device that controls the robot.
The idea of the project is to design a robotic gripper arm which is controlled through gestures. The robotic arm will be controlled through a webcam connected to a PC. The robotic structure will mimic the hand and elbow movements of an actual arm as captured by the webcam. It will also have a firm grip and will be able to grip and lift moderately heavy objects.
In this project, we propose a system that controls the robotic arm remotely by sending human gestures. The gesture movement of hand is captured through webcam, which analyzes the movement of actual arm. This image is processed in PC by lab view software and sends information via Bluetooth module. Power supply is given to arduino and motor driving circuit.Motor driving circuit acts as a bridge between arduino (microcontroller) & motors in robot. Motor driver circuit, control the movement of motors. And robotic arm moves as the movement of actual arm.
This robotic arm performs “PICK AND PLACE” application with full accuracy.
Project ObjectivesThe problem is to complete the work in hazardous places where humans are affected by the harsh environment.Need to build a manually controlled robot for gripping and lifting an object.
The objective is to design a device that replicates the actions of another hand and arm (up to the elbow) and also has a firm grip along with a fair lifting capability. The purpose is robotic arm is to reduce errors and human capability.
Project Implementation MethodTo build a gesture controlled robotic gripper arm first step is research and market survey in which we read a past papers and select the components that to be used in our project to achieve aim. Then design a schematic diagram for the representation of elements of a system and showing the connectivity of electrical components with wiring. The thesis work will be done in whole project timeline. Making a 3d printed robotic arm and will give the ability of firm grip and used for “pick and place” application.Choose the right components based on their quality which are available in market and cost-efficient.Then start to implement hardware according to schematic diagram in the mid of December. A programming code in software by which micro-controller receives the input data from webcam and gives specific command to motor driver related to webcam command, so motors move accordingly. This includes the codes in both Arduino IDE and in Pycharm (for image acquisition). When more than half of the project completes, we will start the testing phase of project, and resolve the errors as identified.At the end of April, we will able to deliver a project.
Benefits of the ProjectRobotics system is a fundamental component in our daily life. Robotic arm is a device that performs the operations in a similar way to humanoid arm, that either move in certain directions. Robotic gripper arm is used in for manufacturing process, for pick and place application, welding, for printed circuit boards, and environment where human being affected by harsh condition. To handle a task that is difficult and dangerous to human being. Robots also used in automobile industry for car manufacturing, in medical field to perform surgeries with small actuators. It performs various tasks with precision and accuracy.
Technical Details of Final DeliverableDeliverables of project:
1. Proper control of robotic structure based on input values.
2. Integration of motors in robotic arm structure.
3. Movement of joints and effective gripping of robotic hand.
4. Accurate arm/finger detection using Webcam.
| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 72400 | |||
| Servo 996r | Equipment | 5 | 700 | 3500 |
| Servo 946r | Equipment | 2 | 700 | 1400 |
| Stepper NEMA17 | Equipment | 1 | 2000 | 2000 |
| Stepper NEMA23 | Equipment | 1 | 3000 | 3000 |
| Arduino MEGA2560 | Equipment | 2 | 4000 | 8000 |
| Arduino UNO | Equipment | 2 | 2000 | 4000 |
| Jumper wire + Arduino Wire | Equipment | 100 | 10 | 1000 |
| HC-05 Bluetooth module | Equipment | 2 | 1500 | 3000 |
| Driver TB6560 | Equipment | 1 | 1500 | 1500 |
| 3D Printed Arm Structure | Equipment | 1 | 20000 | 20000 |
| Elbow Joint with Base | Equipment | 1 | 13000 | 13000 |
| Driver L298N | Equipment | 1 | 500 | 500 |
| LCD 20X4 | Equipment | 1 | 1000 | 1000 |
| BreadBoard | Equipment | 1 | 500 | 500 |
| Printing + Petrol + Consultancy + Others | Miscellaneous | 1 | 10000 | 10000 |