Self Driving Car using artificial intelligence

Project Title

Self Driving Car using artificial intelligence

Project Area of Specialization Artificial IntelligenceProject Summary

This project is about develop a prototype of self driving car. This project of self driving car would be made completely autonomous using the Artificial Intelligence techniques. In this project we are using various Artificial Intelligence techniques like Computer Vision, Convolutional Neural Networks(CNN), Multiclass Classification, Serial Communication, arduino controlling and various other techniques as well.In this project we capture data and process data and then train the data using CNN model prepared. We apply computer vision technique on the captured  to convert it into required format before processing and training data.finally we take live feed and run the car by putting core i5 laptop processor for real time fast computation of the live feed of the camera to process it through the classifier and predict its output that whether to move left, right or straight. Then according to the predicted output it sends command to the 2nd circuit embedded in the car to run and perform accordingly as the model predicts.     

Project Objectives

Self driving cars are the new emerging technologies in market. Self driving cars as a product have been launched in the market and they are seen running on the road facilitating people as google cars,tesla and uber autonomous cars. This product have now become so popular that people are looking forward to this new technology. Self driving car nowadays is not even perfect and complete. Still it need better techniques and some more computation because a number complains have been received since last year about car accidents and misprediction. This product is also dependent on lidar and various sensors which help in its prediction . But we are developing a prototype of self driving car which doesn't require any sensor butb just the computer vision and machine learning algorithms . As a PakistanI want to introduce this new technology in pakistan and we want to make the lives of people as easy as possible. This project gives an introduction to new emerging field in our beloved country. As the president of pakistan has shown alot of interest in this and various new emerging fieldsto make our country independent of other countries in technology. we follow the agenda of president of pakistan and  weare working to achieve this goal of preparing the prototype of self driving car.

Project Implementation Method

we are using a toy car in which 5 years kids can sit and drive car. This car was just a plastic body with buzzers.Initially we had made this car electronically controlled with bluetooth signals. For this we had used and app controlling it and we had embedded and bluetooth sensor with arduino mega2560 and electronic circuit designed as per required. Then we had duild a Convolutional Neural Networks (CNN) model for driving the autonomous car. This project of self driving car includes Computer Vision CNN,python ,arduino ,laptop core i5 processor webcam feed and no sensors. Now this project works as we have made a road like path and then we capture video of the path at the same height where the camera is to be embedded on the roof of the car. Afterwards we break the whole video into frames and grab the required frames. After acquiring the required frames we divide the frames into different classes left ,right ,straight and stop. Training is done using the CNN model prepared of the  classification of the data gathered with webcam feed. Using then the computer vision algorithm the data is converted into required format using gray-scaling, bluring ,canny-edge detection hough-lines transform with slopes and interscepts for drawing the hough lines on the image and then on video and finally on the live feed of the camera. After drawing hough lines the data is trained and a classifier is prepared. During the live session the car takes the feed of the camera and sends it to the model in order to predict whether to move right,left,staright or stop.Its model have 12 layers containing dense,activation,convolutional.and maxpooling etc, with adam as optimizer, catagorical crossentropy, and a very low learning rate of 0.01. The complete processing of the data through classifer model and even the prediction is done by the same laptop. This laptop is set on the car in order to use laptop's core i5 processor for data processing and prediction which is used as a main core processor .Finally the after prediction the model generates a string and that particular string is sent using pyserial communication to the next circuitry which is connected to arduino and arduino contains a code burnt in it which contains wrappers to whom has to work according to the received string generated by the processor containing classifieer model and send using pyserial communication auto detect path and car moves accordingly.

Benefits of the Project

As we all know the self driving cars are the new trend in market and being used by the people as taxis and regular usages as well. Self driving cars are made because people usaually carelesslly and there focus is diverted by some fellows ,friends or family sitting with them while having discussions and cross-talks.people are diverted by some external diversions like phone call, anyone outside waving his or her hand for lift, something interesting or different happening outside the car so people get diverted and results in car crashing and sometimes severe accidents.But the driverless cars don't  have to face these diversions, it only has one focus on the road and to work according to the algorithm designed. So that is why self driving cars have become so famous nowadays because reduces the human efforts and requires no human intervention. The only thing man has to do is to sit in the car and has to enjoy the ride by telling the car its destination. With this much advancement in artificial intelligence the people can now do any thing they desire with no human efforts. This is the reason why we have choosen this topic as our final year project with which a new era  of Artificial Intelligence would be introced in Pakistan. Our foremost goal is to design this project on a small car as a prototype from where we can step forward in future in Pakistan for advancement in Arificccial Intelligence and propose our idea ,prototype ,model and  future goals. These Artificial intelligence  techniques can bring revolution in research and development, design and analysis and in every department which could finally lead to Pakistan's independance of technology on other countries and prosperity in future. Our objective is to work hard as possible as president of Pakistan is showing so much interest in these new emerging fields .and we want to reach the level as President of Pakistan and our country is desiring from us   

Technical Details of Final Deliverable

Our aim is to build prototype of self driving car, which requires no human efforts and no human interventions. This prototype is a small car on which a small childern of 5 years can sit and drive.the Final deliverables of this protytype are as follows:

1. Car would be able to drive on its own by finding its path and predicting ability to move left,right or straight without lidar or any sensor as google car and .

It should be able to recognize objects in its path and recognize stop sign and stops accordingly.     

Final Deliverable of the Project HW/SW integrated systemType of Industry Manufacturing Technologies Artificial Intelligence(AI)Sustainable Development Goals Industry, Innovation and InfrastructureRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	76600
prototype toy car	Equipment	1	20000	20000
arduino mega 2560	Equipment	2	1500	3000
webcam	Equipment	1	14000	14000
track pipes	Equipment	8	350	2800
motor driver h-bridges	Equipment	4	450	1800
motor assembly	Equipment	2	1000	2000
elctronic circuit for controlling	Equipment	1	5000	5000
Udemy paid cources	Miscellaneous	2	5000	10000
laptop core i5 2nd generation	Equipment	1	18000	18000