Ai Surveillance UGV

An unmanned ground vehicle (UGV) roaming in a specified area will be equipped with cameras providing 360 degrees view for surveillance. It will be able to detect and avoid obstacles in its path and will continue to move freely around in human-friendly environment. Personnel can monitor with

Project Title

Ai Surveillance UGV

Project Area of Specialization

Artificial Intelligence

Project Summary

An unmanned ground vehicle (UGV) roaming in a specified area will be equipped with cameras providing 360 degrees view for surveillance. It will be able to detect and avoid obstacles in its path and will continue to move freely around in human-friendly environment.

Personnel can monitor with the help of live streaming. By artificial intelligence, faces and objects will be recognized in its surroundings.

The Vehicle will operate in collaboration with a unmanned aerial vehicle (UAV) which is being developed by another group.

Project Objectives

The objective is to develop a system which could identify the objects and people in its surroundings on its own while moving around and make use of both the UGV and computer vision technology to develop intelligent (AI) surveillance system. Our project will mainly focus on the following objectives:

1. To develop an autonomous face detection, recognition and identification system to smartly identify and distinguish between a known and an unknown person
2. Multiple objects detection to detect anomaly objects in the area
3. Provide real time alerts for above mentioned subjects
4. Provide live coverage of the area to the control station where a personnel can also have a look at what is happening in the area
5. To develop an unmanned vehicle which could roam around the area on its own and avoid obstacles to reach its destination
6. Real time environment observations like temperature, humidity etc.
7. To develop the system to collaborate with the UAV

Project Implementation Method

1. Building the database
   Creating an efficient and stable database as per our design and the requirements. We will use MySQL to develop the database of our recognized persons and detection related information and images
2. Developing the face and object detection algorithms
   The part where all our core processing will occur. For this, we will use OpenCV and some other libraries as per our requirement to develop the Computer Vision algorithms.
3. Developing the semi-autonomous vehicle
   For this, we will implement the map of our field to the system and developing the movement and obstacle avoiding techniques for the UGV.
4. Developing the communication system
   In this phase, we will develop the part of sending and receiving the video stream and the control signals between the UGV and the control station as well as the UAV. Raspberry Pi will be used to attain the wireless communication system.
5. Developing the UI
   For this we will use PAGE to implement our GUI design.
6. Integrating the UGV and UAV
   The programmable devices will communicate with each other to achieve the successful integration of the two different vehicles.

Benefits of the Project

Traditionally, a surveillance system would require some security personnel to be observing the target area over the live streaming of the cameras. The downside was that the personnel could get distracted by anything and miss some events taking place in the target areas. Also, the cameras installed on the ceiling and high up on the walls do not provide clear view of a person from the very front and are stationary.

Our intelligent system will overcome all these drawbacks by smartly surveying the target area by itself and provide real time alerts to the control station of anomalies such as an unidentified person or some forbidden object in the area. The vehicle will be able to provide full frontal view of a person and the area just as if the security personnel himself is roaming into the area.

The vehicle can also be switched to manual mode to be controlled from within the control station by the personnel if he wishes the vehicle to be in some specific place. He can take the vehicle where ever he wants within the target area and have the vehicle cover that area.

The streamed video will be stored on the system in the workstation for up to as many days as per requirement. The anomaly alerts and visuals will also be stored in the database for record keeping purposes.

Lastly with our software alone with some modifications, the companies with limited and tight budget can also implement this intelligent surveillance system on their pre-installed cameras and benefit from the power of AI and computer vision.

Technical Details of Final Deliverable

The raspberry pi will be installed on the vehicle which will provide communication between vehicle and the workstation.

For communication between vehicle and the workstation, a wireless connection will be developed and implemented of high bandwidth for seamless data communication between them.

The video streamed to the workstation will be processed on the system that must be at least core i3 8GB ram with a Nvidia graphic card of at least 2GB memory. System must contain at least 1TB storage device to store video and data.

MySQL DB will be used for storing videos, images, alerts and signals.

For video streaming and processing, we will be using zmq, numpy and openCV etc. And pyqt can be used to control the vehicle remotely.

The batteries on the budget are supposed to run the system seamlessly for 2-3 hours ideally and the batteries will be easily rechargeable.

The GUI will have all the required modules such as watching the streaming, notification center, history and remote vehicle control.

The target area can be around 30-50 meter square depending on the environment, with at least 1 WiFi extendor on the field.

Approriate place for placing the unmanned aerial vehicle (UAV) near the workstation will be required for instant response to any alert or control signal.

Final Deliverable of the Project

HW/SW integrated system

Type of Industry

Security

Technologies

Artificial Intelligence(AI)

Sustainable Development Goals

Industry, Innovation and Infrastructure

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com