← Back to Robotics
cs.RO

How VR lets humans steer drone swarms through unknown spaces

Lou De Bel-Air, Luca Morando, Ruitao Chen, Keru Wang, Benjamin Jarvis, Charbel Toumieh, Yang Zhou, Ken Perlin, Dario Floreano, Giuseppe Loianno

May 20, 2026

Autonomous drone teams struggle when environments are cluttered and unpredictable. Researchers built a VR system where an operator steers a swarm using motion primitives—reusable movement patterns—while the drones handle collision avoidance and spacing automatically. The operator sees the drones' full state in mixed reality (physical and simulated robots together) and can nudge the team toward regions an autonomous planner might miss. Tests show this shared control cuts crashes, maintains safe spacing between drones, and cuts the cognitive load on pilots compared to fully manual flight.
Published as Flying Together: Human-Guided Immersive Shared Control for Aerial Robot Teams in Unknown Environments arXiv:2605.21680
Read the original paper →