2024/10/17 by Jameson Merkow, Felix J. Dorfner, Merkow, Jameson +16
Computer Science · Engineering · Medicine · #Advanced MRI Techniques and Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Flow Measurement and Analysis #Image and Video Processing (eess.IV) #Machine Learning (cs.LG) #Neural Networks and Applications #cs.CV #cs.LG #eess.IV #electronic engineering #information engineering
paper · pdf · doi:10.48550/arxiv.2410.13174
openalex publication_date 2024/10/17 · openalex created_date 2025/10/10 · arxiv created 2026/07/29 · arxiv updated 2026/07/31 · openalex updated_date 2026/08/02
The integration of artificial intelligence (AI) into medical imaging has advanced clinical diagnostics but poses challenges in managing model drift and ensuring long-term reliability. To address these challenges, we develop MMC+, an enhanced framework for scalable drift monitoring, building upon the CheXstray framework that introduced real-time drift detection for medical imaging AI models using multi-modal data concordance. This work extends the original framework's methodologies, providing a more scalable and adaptable solution for real-world healthcare settings and offers a reliable and cost-effective alternative to continuous performance monitoring addressing limitations of both continuous and periodic monitoring methods. MMC+ introduces critical improvements to the original framework, including more robust handling of diverse data streams, improved scalability with the integration of foundation models like MedImageInsight for high-dimensional image embeddings without site-specific training, and the introduction of uncertainty bounds to better capture drift in dynamic clinical environments. Validated with real-world data from Massachusetts General Hospital during the COVID-19 pandemic, MMC+ effectively detects significant data shifts and correlates them with model performance changes. While not directly predicting performance degradation, MMC+ serves as an early warning system, indicating when AI systems may deviate from acceptable performance bounds and enabling timely interventions. By emphasizing the importance of monitoring diverse data streams and evaluating data shifts alongside model performance, this work contributes to the broader adoption and integration of AI solutions in clinical settings.