Detail aplikovaného výsledku

DroCo - Multi-Drone Control Vizualization Tool

BERAN, V.; BAMBUŠEK, D.; HUBINÁK, R.; SEDLMAJER, K.

Originální název

DroCo - Multi-Drone Control Vizualization Tool

Anglický název

DroCo - Multi-Drone Control Vizualization Tool

Druh

Software

Abstrakt

DroCo is a tool for effective drone remote control using mixed reality, that also supports communication and cooperation on a mission with multiple drones. The proposed solution is inspired by the high mental load of the pilot in the control of the drone, especially in the performance of more complex missions (multiple drones, remote target, proximity to infrastructure etc.). The system is based on the extension of the 3D virtual model with real data (augmented virtuality). It uses temporal and spatial registration of: 

  1. off-line data (map data, elevation data, 3D building models), 
  2. on-line data (video-stream, reconstructed 3D structures, location information, flight data), and 
  3. virtual control objects (navigation points and directions, spatial areas and geo-fences, position of other drones, distance to nearby objects, preview map, or view from other drones). 
The system thus allows you to pilot the drone in FPV (first-person-view), but at any time it can switch to TPV (third-person-view), so that one can look around freely in a situation with poor orientation, further directs the pilot to other mission objectives, points out close objects or other drones, etc. The system is currently being expanded with the functions of multiple drones, sharing more sensory information across the system, increasing the security of network communication. The development also aims to use a system for drone control training for pilots, increase the realism of drone behavior in simulated mode, more efficient mission management and visualization of the status for the operator of the whole event.
 

Abstrakt aglicky

DroCo is a tool for effective drone remote control using mixed reality, that also supports communication and cooperation on a mission with multiple drones. The proposed solution is inspired by the high mental load of the pilot in the control of the drone, especially in the performance of more complex missions (multiple drones, remote target, proximity to infrastructure etc.). The system is based on the extension of the 3D virtual model with real data (augmented virtuality). It uses temporal and spatial registration of: 

  1. off-line data (map data, elevation data, 3D building models), 
  2. on-line data (video-stream, reconstructed 3D structures, location information, flight data), and 
  3. virtual control objects (navigation points and directions, spatial areas and geo-fences, position of other drones, distance to nearby objects, preview map, or view from other drones). 
The system thus allows you to pilot the drone in FPV (first-person-view), but at any time it can switch to TPV (third-person-view), so that one can look around freely in a situation with poor orientation, further directs the pilot to other mission objectives, points out close objects or other drones, etc. The system is currently being expanded with the functions of multiple drones, sharing more sensory information across the system, increasing the security of network communication. The development also aims to use a system for drone control training for pilots, increase the realism of drone behavior in simulated mode, more efficient mission management and visualization of the status for the operator of the whole event.
 

Klíčová slova

visualization tool, drone control, multi-drone system, augmented virtuality

Klíčová slova anglicky

visualization tool, drone control, multi-drone system, augmented virtuality

Umístění

https://github.com/robofit/drone_vstool

Licenční poplatek

K využití výsledku jiným subjektem je vždy nutné nabytí licence

www

https://github.com/robofit/drone_vstool

Dokumenty

DroCo_GUI-AR_elements_example
DroCo_GUI-AR_elements_example_en
DroCo_TestFlight
VI068_R3_2020_TZ_DroCo