2025/04/14 by Pratham Darrpan Mehta, Mehta, Pratham Darrpan, Vidhi Kulkarni +8
Computer Science · Medicine · #Augmented Reality Applications #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Surgical Simulation and Training #Virtual Reality Applications and Impacts
paper · pdf · doi:10.48550/arxiv.2504.10440
openalex publication_date 2025/04/14 · openalex created_date 2025/10/14 · openalex updated_date 2026/07/28
Surgical planning for congenital heart disease traditionally relies on collaborative group examinations of a patient's 3D-printed heart model, a process that lacks flexibility and accessibility. While mobile augmented reality (AR) offers a promising alternative with its portability and familiar interaction gestures, existing solutions limit collaboration to users in the same physical space. We developed HybridCollab, the first iOS AR application that introduces a novel paradigm that enables both in-person and remote medical teams to interact with a shared AR heart model in a single surgical planning session. For example, a team of two doctors in one hospital room can collaborate in real time with another team in a different hospital.Our approach is the first to leverage Apple's GameKit service for surgical planning, ensuring an identical collaborative experience for all participants, regardless of location. Additionally, co-located users can interact with the same anchored heart model in their shared physical space. By bridging the gap between remote and in-person collaboration across medical teams, HybridCollab has the potential for significant real-world impact, streamlining communication and enhancing the effectiveness of surgical planning. Watch the demo: https://youtu.be/hElqJYDuvLM.