Coarse-to-Fine Joint Registration of MR and Ultrasound Images via Imaging Style Transfer

2025/08/07 by Wang, Junyi, Zhu, Xi, Guo, Yikun +4
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #electronic engineering #information engineering

paper · doi:10.48550/arxiv.2508.05240

Abstract

We developed a pipeline for registering pre-surgery Magnetic Resonance (MR) images and post-resection Ultrasound (US) images. Our approach leverages unpaired style transfer using 3D CycleGAN to generate synthetic T1 images, thereby enhancing registration performance. Additionally, our registration process employs both affine and local deformable transformations for a coarse-to-fine registration. The results demonstrate that our approach improves the consistency between MR and US image pairs in most cases.

Citations

• Unpaired Brain MR-to-CT Synthesis using a Structure-Constrained CycleGAN

Related

• MR2US-Pro: Prostate MR to Ultrasound Image Translation and Registration Based on Diffusion Models
• Global Multi-modal 2D/3D Registration via Local Descriptors Learning
• Test Time Optimized Generalized AI-based Medical Image Registration Method
• Revisiting registration-based synthesis: A focus on unsupervised MR image synthesis
• A 3D Cross-modal Keypoint Descriptor for MR-US Matching and Registration