Using NLP and Mixed Reality to Control a Drone

The normal approach to delivering any physical objects from one place to another is to pick it up and carry it to its destination. This is done by a person who has to travel some distance to deliver the object. This approach becomes time-consuming when the delivery person is stuck in a traffic jam w

Project Title

Using NLP and Mixed Reality to Control a Drone

Project Area of Specialization

Artificial Intelligence

Project Summary

The normal approach to delivering any physical objects from one place to another is to pick it up and carry it to its destination. This is done by a person who has to travel some distance to deliver the object. This approach becomes time-consuming when the delivery person is stuck in a traffic jam which delays the delivery to a few hours or even days depending upon the destination which could either be within the city or outside the city. Our goal is to make the delivery system more efficient and convenient. And for that, we are developing a hardware and software integrated system that uses a drone to dispatch the items from one place to another without wasting time. 

It can be used for delivery of any sort of light or semi-light object. Such a product is useful in today's era where people are not allowed to leave their homes and also harmless, as it is a contactless delivery system; viruses will not transfer easily. It is highly useful for medical emergencies as well. Such as requiring blood bottle or medicines for a critical patient from another destination in less time. It allows customers to get their hands on something they ordered online and want it to be delivered in a few hours instead of a few days.

Project Objectives

In times like COVID-19, the need for making life's essential needs readily available from home emerged. To develop this project is to contribute to the problems faced in such scenarios. The project objectives are mentioned below;

1. To decrease manual labor.

2. To provide efficient and quick delivery system.

3. To minimize the possibility of unsuccessful delivered packages.

4. To maximize the reward of on-time delivery.

5. To minimize delivery cost.

6. To build a system that is easy and fun to handle (an understandable mechanism).

Project Implementation Method

To implement natural language processing and mixed reality in our system we will use the programming language Python and Java to operate the system. For the development, we will use PyCharm and Android Studio. To connect our software with the real world; drone, we will use the raspberry pi. Popular python libraries such as Natural Language Toolkit will be used to implement NLP in the system.

Benefits of the Project

1. Reduces manual labor

2. More work in less time

3. Easy to handle and use

4. Easy mechanism

5. Quick service

6. Cost-efficient

7. Easy to manage

8. Eco-friendly

9. Increased productivity

10. Introducing AI in daily chores

11. Harmless at situations like COVID-19

Technical Details of Final Deliverable

The final product can be used by any company that offers delivery of their products and wants to make the delivery process more efficient, convenient, safe and quick. Instead of a delivery person, the drone will deliver the products. A person will be required to operate the drone through the natural language, he/she can ask the drone to pick up or drop items, take off, land or move/travel. The commands given to drone in natural language will be recognized by the python libraries and the drone will process according to it. Or through mixed reality, he/she can control the drone with the virtual controls and drop the product at the destination in the shortest time possible.

Final Deliverable of the Project

HW/SW integrated system

Core Industry

IT

Other Industries

Core Technology

Artificial Intelligence(AI)

Other Technologies

Sustainable Development Goals

Industry, Innovation and Infrastructure

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com