vix.ing · top · new · best · stats · spec

Spot-On: A Mixed Reality Interface for Multi-Robot Cooperation

2025/05/28 by Tim Engelbracht, Engelbracht, Tim, Petar Lukovic +13
Computer Science · Engineering · Psychology · #Augmented Reality Applications #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Robotics (cs.RO) #Robotics and Sensor-Based Localization #Social Robot Interaction and HRI

paper · pdf · doi:10.48550/arxiv.2505.22539

openalex publication_date 2025/05/28 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Recent progress in mixed reality (MR) and robotics is enabling increasingly sophisticated forms of human-robot collaboration. Building on these developments, we introduce a novel MR framework that allows multiple quadruped robots to operate in semantically diverse environments via a MR interface. Our system supports collaborative tasks involving drawers, swing doors, and higher-level infrastructure such as light switches. A comprehensive user study verifies both the design and usability of our app, with participants giving a "good" or "very good" rating in almost all cases. Overall, our approach provides an effective and intuitive framework for MR-based multi-robot collaboration in complex, real-world scenarios.

Citations

Related