DroCo - Multi-Drone Control Vizualization Tool

visualization tool, drone control, multi-drone system, augmented virtuality

DroCo is a tool for effective drone remote control using mixed reality, that also supports communication and cooperation on a mission with multiple drones. The proposed solution is inspired by the high mental load of the pilot in the control of the drone, especially in the performance of more complex missions (multiple drones, remote target, proximity to infrastructure etc.). The system is based on the extension of the 3D virtual model with real data (augmented virtuality). It uses temporal and spatial registration of: 

1. off-line data (map data, elevation data, 3D building models), 
2. on-line data (video-stream, reconstructed 3D structures, location information, flight data), and 
3. virtual control objects (navigation points and directions, spatial areas and geo-fences, position of other drones, distance to nearby objects, preview map, or view from other drones). 

The system thus allows you to pilot the drone in FPV (first-person-view), but at any time it can switch to TPV (third-person-view), so that one can look around freely in a situation with poor orientation, further directs the pilot to other mission objectives, points out close objects or other drones, etc. The system is currently being expanded with the functions of multiple drones, sharing more sensory information across the system, increasing the security of network communication. The development also aims to use a system for drone control training for pilots, increase the realism of drone behavior in simulated mode, more efficient mission management and visualization of the status for the operator of the whole event.

https://github.com/robofit/drone_vstool

For information on license conditions, please contact: Ing. Kristýna Dvořáčkova, MSc., Information Technology Research Center, Faculty of Information Technology, Brno University of Technology, Božetěchova 2, 612 66 Brno, tel. 541 141 466.

• png DroCo_GUI-AR_elements_example_en.png 731 KB
• png DroCo_GUI-AR_elements_example.png 691 KB
• png DroCo_TestFlight.png 1058 KB
• pdf VI068_R3_2020_TZ_DroCo.pdf 884 KB