Simulating realistic surgeon decisions and actions in immersive medical distance education with XR and AI

2025/09/10 by Yves Shabo Nkulu-Ily, Eric A. Gantwerker, Neil Vaughan +2 · 1 voice
Medicine · Computer Science · #Surgical Simulation and Training #Augmented Reality Applications #Artificial Intelligence in Healthcare and Education

paper · doi:10.1080/10494820.2025.2542893

openalex publication_date 2025/09/10 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/27

Abstract

This research aims to improve distance education in orthopedic surgery by leveraging extended reality (XR) and artificial intelligence (AI). It focuses on skill acquisition, feedback, and behavioral training in clinical settings. The study involved 57 experts and included surveys, interviews, and literature reviews to explore how these technologies can improve medical education, focusing on the Challenge Point Framework (CPF). A cognitive task analysis was performed with six experts to refine the XR and AI system, ensuring it aligns with competency-based educational standards for orthopedic surgery. The findings highlight the importance of XR and AI in higher education, promoting the democratization of XR educational tools. The study also examines CPF algorithms for training in total knee replacement (TKR) surgery within virtual environments, aiming to improve mathematical modeling and explore how humans and AI can collaborate in surgical practices. The research seeks to develop customized XR applications for different educational areas, providing a framework for using XR and AI in TKR training. This initiative aims to change how orthopedic education is delivered, enhancing the training experience for surgical professionals. By applying activity theory, the study plans to create an engaging learning experience that enhances both knowledge and practical skills in the field.

Citations

• Challenge Point: A Framework for Conceptualizing the Effects of Various Practice Conditions in Motor Learning
• Teaching Surgical Skills — Changes in the Wind
• Siri, Siri, in my hand: Who’s the fairest in the land? On the interpretations, illustrations, and implications of artificial intelligence
• Review on Convolutional Neural Networks (CNN) in vegetation remote sensing
• Bootstrap SGD: Algorithmic Stability and Robustness
• Is Algorithmic Stability Testable? A Unified Framework under Computational Constraints
• Defining Problem from Solutions: Inverse Reinforcement Learning (IRL) and Its Applications for Next-Generation Networking
• Algorithmic stability implies training-conditional coverage for distribution-free prediction methods
• Hypothesis Transfer Learning with Surrogate Classification Losses: Generalization Bounds through Algorithmic Stability
• Inverse Reinforcement Learning without Reinforcement Learning
• Black-box tests for algorithmic stability
• Regularization Guarantees Generalization in Bayesian Reinforcement Learning through Algorithmic Stability
• Algorithmic Stability and Generalization of an Unsupervised Feature Selection Algorithm
• A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda
• Literature review as a research methodology: An overview and guidelines
• A Survey of Inverse Reinforcement Learning: Challenges, Methods and Progress
• A survey of inverse reinforcement learning: Challenges, methods and progress
• Stability and Generalization of Learning Algorithms that Converge to Global Optima
• An Introduction to Convolutional Neural Networks
• Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions

Discussions

• Research: doi.org/10.1080/1049... Interactive Learning Environments, Taylor and Francis @tandfresearch.bsky.social #artificialintelligence #challengepointframework #distanceeducation #extendedrealit [bsky, 1 points, 0 comments]

Related

• Artificial intelligence in orthopaedics surgery: transforming technological innovation in patient care and surgical training
• Virtual reality headset versus traditional training in orthopedic surgery: A comparative study on real surgical performance in total knee arthroplasty
• Immersive training of clinical decision making with AI driven virtual patients – a new VR platform called medical tr.AI.ning
• Evaluation of Skill Level Between Trainees and Community Orthopaedic Surgeons Using a Virtual Reality Arthroscopic Knee Simulator
• Towards Effective Immersive Technologies in Medicine: Potential and Future Applications based on VR, AR, XR and AI solutions