Gestured based android human drone interface for intuitive movement control
Commercial drones are becoming increasingly popular with new ones being introduced regularly as well as new methods and devices to control them. This report details an attempt to utilise gestures to control drones without using other means concurrently such as a joystick. During the length of the pr
2025-06-28 16:32:45 - Adil Khan
Gestured based android human drone interface for intuitive movement control
Project Area of Specialization Computer ScienceProject SummaryCommercial drones are becoming increasingly popular with new ones being introduced regularly as well as new methods and devices to control them. This report details an attempt to utilise gestures to control drones without using other means concurrently such as a joystick. During the length of the project several approaches were assessed in terms of suitability for the aims of the project. Consequently the most appropriate techniques and technology was chosen from the available options. This led to the attempt being mostly successful in meeting the initial aim although with some problems and unachieved objectives.
- The topic we are concerned with here is the gesture control of an drone.
- Our project is concern to provide the interface to interact with drone in a natural way .
- Using gesture anyone can interact with the drone in a human friendly fashion.
- gestures can be a very effective medium in carrying out the given task.
Researchers from the Human-Computer Interaction (HCI) and computer vision area have proposed some natural interfaces by which one can drive the drone in natural way. The previous implementations of gesture control of a Drone on platforms like cyclone.js and nodecopter using the Leap motion controller or Kinect.We only require a Android device to control a drone in human friendly fashion.
Project ObjectivesThe purpose of the “Android Drone” project was to create a quadcopter that can be controlled by user input sent over the phone’s Wi-Fi connection or 4G internet connection. Furthermore, the purpose was also to be able to receive live video feedback over the internet connection, thus making the drone an inexpensive option compared to other, equivalent drones that might cost thousands of dollars. Not only that, but the Android phone also has a host of other useful features that could be utilized by the drone: this includes GPS, pathing, picture taking, data storage, networking and TCP/IP, a Java software environment, and a large, diverse variety of Android software endpoints that allow for things like facial recognition or motion detection. Ultimately, this project was intended to give a cost effective means of adding hundreds of potential features to a standard quadcopter. Although there were other ways of implementing this project, such as buying a Wi-Fi or GPS module and connecting it directly to a microcontroller, the Android phone option represents a much more versatile option that includes significantly higher processing power for the future development of this project.
Project Implementation MethodKanban Development Methodology
- KANBAN is a process that helps teams to collaborate and work effectively
- this excellent development is suitable for prompt development of software that happens to include a series of iterations to generate required software.
- It is a perfect approach because it effortlessly brings on track the deliberate progressing projects.
Commercial drones are becoming increasingly popular with new ones being introduced regularly as well as new methods and devices to control them. This report details an attempt to utilise gestures to control drones without using other means concurrently such as a joystick. During the length of the project several approaches were assessed in terms of suitability for the aims of the project. Consequently the most appropriate techniques and technology was chosen from the available options. This led to the attempt being mostly successful in meeting the initial aim although with some problems and unachieved objectives.
- The topic we are concerned with here is the gesture control of an drone.
- Our project is concern to provide the interface to interact with drone in a natural way .
- Using gesture anyone can interact with the drone in a human friendly fashion.
- gestures can be a very effective medium in carrying out the given task.
Researchers from the Human-Computer Interaction (HCI) and computer vision area have proposed some natural interfaces by which one can drive the drone in natural way. The previous implementations of gesture control of a Drone on platforms like cyclone.js and nodecopter using the Leap motion controller or Kinect.We only require a Android device to control a drone in human friendly fashion.
Technical Details of Final DeliverableWe have to be expert in these concept and technologies.
-
-
- Android device should have following the minimum requirements:
- ARM 32 bits Single-core processor, 512MB RAM, 802.11 wireless LAN for Wi-Fi communication, and gyroscope and accelerometer .
- Tensor?ow will use for the neural network design.
- Bebop SDK will use for communicating with a FCU (Flight Control Unit) of Bebop 2
- Communication between the android device and drones will be through via Wi-Fi.
- Android device should have following the minimum requirements:
-
| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 70000 | |||
| drone | Equipment | 1 | 70000 | 70000 |