An Augmented Reality Interaction Interface for Autonomous Drone

2020/08/05 by Chuhao Liu, Shaojie Shen, Liu, Chuhao +1 · 1 citation
Computer Science · Engineering · #Augmented Reality Applications #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Robotic Path Planning Algorithms #Robotics (cs.RO) #Robotics and Sensor-Based Localization

paper · pdf · doi:10.48550/arxiv.2008.02234

openalex publication_date 2020/08/05 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Human drone interaction in autonomous navigation incorporates spatial interaction tasks, including reconstructed 3D map from the drone and human desired target position. Augmented Reality (AR) devices can be powerful interactive tools for handling these spatial interactions. In this work, we build an AR interface that displays the reconstructed 3D map from the drone on physical surfaces in front of the operator. Spatial target positions can be further set on the 3D map by intuitive head gaze and hand gesture. The AR interface is deployed to interact with an autonomous drone to explore an unknown environment. A user study is further conducted to evaluate the overall interaction performance.

Cited by

• IGUANA: Immersive Guidance, Navigation, and Control for Consumer UAV

Related

• FlightAR: AR Flight Assistance Interface with Multiple Video Streams and Object Detection Aimed at Immersive Drone Control
• DroneARchery: Human-Drone Interaction through Augmented Reality with Haptic Feedback and Multi-UAV Collision Avoidance Driven by Deep Reinforcement Learning
• Improving Usability, Efficiency, and Safety of UAV Path Planning through a Virtual Reality Interface
• Embodied Flight with a Drone
• Spatial Assisted Human-Drone Collaborative Navigation and Interaction through Immersive Mixed Reality