Multi-modal Sensor Fusion (Camera, LiDAR) for Environmental Depth Perception for Autonomous Vehicles
Our final year project is based on data acquisition, and visual perception for autonomous vehicles. The main objective is to develop sensor fusion model by gathering results from LIDAR and stereo-cameras and fusing it to estimate a depth map of short range. At the end of the project, we will be able
Project Title
Multi-modal Sensor Fusion (Camera, LiDAR) for Environmental Depth Perception for Autonomous Vehicles
Project Area of Specialization
Project Summary
Our final year project is based on data acquisition, and visual perception for autonomous vehicles. The main objective is to develop sensor fusion model by gathering results from LIDAR and stereo-cameras and fusing it to estimate a depth map of short range. At the end of the project, we will be able to perform LIDAR and stereo-camera calibration and create an algorithm that will apply sensor acquisition techniques utilizing LIDAR, computer vision and deep learning models to estimate depth maps obtained in real time. We will also use coding libraries such as OpenCV in our perception model. Completion of the project also includes mounting and acquiring data from sensors and testing the optimum algorithm on Jetson development kit.
Project Objectives
 for Environmental Depth Perception for Autonomous Vehicles ' _1659401897.png)
- Perception: Our objective is to build a perception system which can create a real time depth map of its surroundings.
- Enhancing Skillset: Building this project will require us to gain knowledge about autonomous systems and computer vision which will be a great learning experience for us.
- Industrial Implementation: By using the learning outcomes from this project and applying it in industry will help speed up the production of autonomous cars in Pakistan.
- Research: Researching the development and use of autonomous vehicles in Pakistan.
Project Implementation Method
 for Environmental Depth Perception for Autonomous Vehicles ' _1659401898.png)
1: Hardware & Sourcing :
- Acquiring ATV, LIDAR And stereo-cameras.
- Designing the sensor brackets in solidworks.
- Mounting those brackets on an ATV.
2: Software & Design:
- Acquire data from sensors.
- Calibrating the sensors.
- Sensor synchronization: Synchronizing the frame rate of both LIDAR and stereo-camera.
- Transforming sensor inputs.
3: Implementation of Sensor Fusion:
- Generating a depth map and using kalmal filtering.
- Improving depth map.
4: Depth Map Estimation
Benefits of the Project
 for Environmental Depth Perception for Autonomous Vehicles ' _1659401899.png)
Technical Details of Final Deliverable
- Sensing system utilizing LIDAR and stereo cameras.
- Short range depth perception.
- Real time depth perception in a controlled environment.
Final Deliverable of the Project
Core Industry
Other Industries
Core Technology
Other Technologies
Sustainable Development Goals
Required Resources
| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Benewake: Long-Distance LiDAR Module TF03 | Equipment | 1 | 40000 | 40000 |
| Nvidia: Jetson Nano Developer Kit B01 - 4GB | Equipment | 1 | 30000 | 30000 |
| Sensor Brackets | Miscellaneous | 3 | 3300 | 9900 |
| Total in (Rs) | 79900 |
If you need this project, please contact me on contact@adikhanofficial.com
Bridget
Bridget is a link between the commercially setup Heating, Ventilation and Air Conditioning...
Online art gally
Introduction: Online Art Gallery is website that allows ...
Authorized Personnel Corporate Security
Our project will show how we can implement algorithms for face detection and recognition i...
Pinpoint
Sukkur IBA University provides a very good system for transport for its students, staff an...
Automatic Water Tap System
As we know, natural resources are most important for human life. With the passage of time...