2025/02/14 by Tianyu Song, Song, Tianyu, Felix Pabst +5 · 2 citations
Computer Science · Decision Sciences · Medicine · #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Impact of AI and Big Data on Business and Society #Surgical Simulation and Training #Virtual Reality Applications and Impacts
paper · pdf · doi:10.48550/arxiv.2502.10088
openalex publication_date 2025/02/14 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Robotic ultrasound systems can enhance medical diagnostics, but patient acceptance is a challenge. We propose a system combining an AI-powered conversational virtual agent with three mixed reality visualizations to improve trust and comfort. The virtual agent, powered by a large language model, engages in natural conversations and guides the ultrasound robot, enhancing interaction reliability. The visualizations include augmented reality, augmented virtuality, and fully immersive virtual reality, each designed to create patient-friendly experiences. A user study demonstrated significant improvements in trust and acceptance, offering valuable insights for designing mixed reality and virtual agents in autonomous medical procedures.