2018/03/22 by Mathias Unberath, Jan-Nico Zaech, Unberath, Mathias +11 · 12 citations
Engineering · Medicine · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Physical sciences #Medical Imaging and Analysis #Medical Physics (physics.med-ph) #Pelvic and Acetabular Injuries #Radiomics and Machine Learning in Medical Imaging
paper · pdf · doi:10.48550/arxiv.1803.08606
openalex publication_date 2018/03/22 · openalex created_date 2022/10/02 · openalex updated_date 2026/07/28
Machine learning-based approaches outperform competing methods in most\ndisciplines relevant to diagnostic radiology. Interventional radiology,\nhowever, has not yet benefited substantially from the advent of deep learning,\nin particular because of two reasons: 1) Most images acquired during the\nprocedure are never archived and are thus not available for learning, and 2)\neven if they were available, annotations would be a severe challenge due to the\nvast amounts of data. When considering fluoroscopy-guided procedures, an\ninteresting alternative to true interventional fluoroscopy is in silico\nsimulation of the procedure from 3D diagnostic CT. In this case, labeling is\ncomparably easy and potentially readily available, yet, the appropriateness of\nresulting synthetic data is dependent on the forward model. In this work, we\npropose DeepDRR, a framework for fast and realistic simulation of fluoroscopy\nand digital radiography from CT scans, tightly integrated with the software\nplatforms native to deep learning. We use machine learning for material\ndecomposition and scatter estimation in 3D and 2D, respectively, combined with\nanalytic forward projection and noise injection to achieve the required\nperformance. On the example of anatomical landmark detection in X-ray images of\nthe pelvis, we demonstrate that machine learning models trained on DeepDRRs\ngeneralize to unseen clinically acquired data without the need for re-training\nor domain adaptation. Our results are promising and promote the establishment\nof machine learning in fluoroscopy-guided procedures.\n