Smart Robotic Arm With Camera Eye

The main objective of the project is to design and program an Artificial Intelligence based Robotic Arm that could be used to grab different objects placed in a predefined area at different orientations. The camera interface attached with the smart robotic arm will be responsible to capture the deta

Project Title

Smart Robotic Arm With Camera Eye

Project Area of Specialization

Robotics

Project Summary

The main objective of the project is to design and program an Artificial Intelligence based Robotic Arm that could be used to grab different objects placed in a predefined area at different orientations. The camera interface attached with the smart robotic arm will be responsible to capture the details of the object being grabbed like the size, position and the orientation.

The hardware interface would then use AI algorithms to take decisions about the location, size and orientation of the object and would guide the smart robotic arm to grab the desired object. The overall task is complex one because the size, position and orientation of the object could change for different objects in real time and the smart robotic arm has to decide its movement based on the real time data acquired for the objects via camera eye.

The whole design would resemble like an actual human arm/hand but would be confined to the size, position and orientation of the object being grabbed.

Project Objectives

The Smart Robotic Arm with a Camera Eye would have the following features/objectives:

• The camera eye would be used to capture the details of the object being grabbed.
• AI algorithms would be used to measure the position, size and orientation of the object.
• Hardware would derive the robotic arm to the desire location with actual details of the size and orientation of the object.
• The object will be grabbed by the robotic arm and will be placed on a predefined place with predefined orientation.

The overall system would require a Real Time hardware interface with both the camera eye and the robotic arm. The AI algorithms would be responsible to determine the actual details of the object and derive the robotic arm accordingly. The current project is very different from the other designs already available in the market where the robotic arm is used to pick an object from the predefined position with predefined size and orientation. In our design position, size and orientation of the object are variable and the AI algorithms would be responsible to measure these parameters and drive the robotic arm accordingly

Project Implementation Method

We have done with the controlling of motors, which include PWM control, Speed Control, Movement Control i;e how much degree each joint (motor) is required to move to a desired location to pick the targeted object. Now we are working on Image Processing Techniques. As, Our project includes a Camera Eye which is responsible for capturing the image and behaves like an input. Input in this way that it will take the image and pass the information like position, orientation of the object to the Raspberry Pi. Raspbeery then keep the data and convert image data to digital signals which will be then passed to the motor that how much each motor is required to move to grab the object. This is overall a complex task but is a major part of our project.

Tools and Techniques:

• Raspberry Pi
• Python Language for programming
• MATLAB
• Digital Image Processing and AI techniques
• Mechanical hardware for making a robotic hand
• Servo Motors
• Different Lab instruments like digital multi-meter, power supply, oscilloscope etc.
• Could require electronic design for different parts as well

Benefits of the Project

As mentioned above the current system is not being designed and fabricated in Pakistan. The available robotic arms are mainly responsible for picking object from a single position. However, our design could grab different objects from different positions with different size and orientations placed in a predefined area. Therefore, this design could be used in a many industries where the position, size and orientation (new requirements) of the object being grabbed are changing over time and the robotic arm has to decide by itself about these parameters to grab the object.

Our design could be used in the following industries:

• All mechanical type industries like cars industry etc.
• Food industry for picking food items.
• All other parts making industries.

Or it could be used in every industry that include Robotics work.

Technical Details of Final Deliverable

Our final product will be a fully-functional AI based Robotic Arm with camera eye which will work intelligently in every industry which includes picking and placing of object, in Warehouses etc. We are very Passionate about that.

Final Deliverable of the Project

Hardware System

Core Industry

Others

Other Industries

Food , Manufacturing

Core Technology

Robotics

Other Technologies

Artificial Intelligence(AI)

Sustainable Development Goals

Industry, Innovation and Infrastructure, Responsible Consumption and Production

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com