Tumor Synthesis conditioned on Radiomics
2025/09/29 by Kim, Jonghun, Na, Inye, Ko, Eun Sook +1
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
paper · doi:10.48550/arxiv.2509.24182
Abstract
Due to privacy concerns, obtaining large datasets is challenging in medical image analysis, especially with 3D modalities like Computed Tomography (CT) and Magnetic Resonance Imaging (MRI). Existing generative models, developed to address this issue, often face limitations in output diversity and thus cannot accurately represent 3D medical images. We propose a tumor-generation model that utilizes radiomics features as generative conditions. Radiomics features are high-dimensional handcrafted semantic features that are biologically well-grounded and thus are good candidates for conditioning. Our model employs a GAN-based model to generate tumor masks and a diffusion-based approach to generate tumor texture conditioned on radiomics features. Our method allows the user to generate tumor images according to user-specified radiomics features such as size, shape, and texture at an arbitrary location. This enables the physicians to easily visualize tumor images to better understand tumors according to changing radiomics features. Our approach allows for the removal, manipulation, and repositioning of tumors, generating various tumor types in different scenarios. The model has been tested on tumors in four different organs (kidney, lung, breast, and brain) across CT and MRI. The synthesized images are shown to effectively aid in training for downstream tasks and their authenticity was also evaluated through expert evaluations. Our method has potential usage in treatment planning with diverse synthesized tumors.
Citations
- RadiomicsFill-Mammo: Synthetic Mammogram Mass Manipulation with Radiomics Features
- Synthetic Tumor Manipulation: With Radiomics Features
- Diverse Data Augmentation with Diffusions for Effective Test-time Prompt Tuning
- ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shifting
- The KiTS21 Challenge: Automatic segmentation of kidneys, renal tumors, and renal cysts in corticomedullary-phase CT
- Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models
- CoLa-Diff: Conditional Latent Diffusion Model for Multi-Modal MRI Synthesis
- Scaling up GANs for Text-to-Image Synthesis
- Adding Conditional Control to Text-to-Image Diffusion Models
- Adding Conditional Control to Text-to-Image Diffusion Models
- Effective Data Augmentation With Diffusion Models
- MedSegDiff-V2: Diffusion based Medical Image Segmentation with Transformer
- Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation
- Diffusion Models for Medical Image Analysis: A Comprehensive Survey
- Make-A-Video: Text-to-Video Generation without Text-Video Data
- Brain Imaging Generation with Latent Diffusion Models
- Diffusion Models: A Comprehensive Survey of Methods and Applications
- BBDM: Image-to-image Translation with Brownian Bridge Diffusion Models
- Hierarchical Text-Conditional Image Generation with CLIP Latents
- RePaint: Inpainting using Denoising Diffusion Probabilistic Models
- High-Resolution Image Synthesis with Latent Diffusion Models
- High-Resolution Image Synthesis with Latent Diffusion Models
- DiffuseMorph: Unsupervised Deformable Image Registration Using Diffusion Model
- Palette: Image-to-Image Diffusion Models
- Breaking the Dilemma of Medical Image-to-image Translation
- The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classification
- Cascaded Diffusion Models for High Fidelity Image Generation
- Image Super-Resolution via Iterative Refinement
- StyleCLIP: Text-Driven Manipulation of StyleGAN Imagery
- Review of deep learning: concepts, CNN architectures, challenges, applications, future directions
- Taming Transformers for High-Resolution Image Synthesis
- nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation
- Score-Based Generative Modeling through Stochastic Differential Equations
- Denoising Diffusion Implicit Models
- DF-GAN: A Simple and Effective Baseline for Text-to-Image Synthesis
- Denoising Diffusion Probabilistic Models
- A Style-Based Generator Architecture for Generative Adversarial Networks
- Multimodal Unsupervised Image-to-Image Translation
- Cross-Modality Synthesis from CT to PET using FCN and GAN Networks for Improved Automated Lesion Detection
- AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks
- Computational Radiomics System to Decode the Radiographic Phenotype
- CT Texture Analysis: Definitions, Applications, Biologic Correlates, and Challenges
- Deep Learning for Medical Image Analysis
- Attention Is All You Need
- VEEGAN: Reducing Mode Collapse in GANs using Implicit Variational Learning
- Deep Learning for Medical Image Processing: Overview, Challenges and Future
- The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-based Phenotyping
- StackGAN: Text to Photo-realistic Image Synthesis with Stacked\n Generative Adversarial Networks
- Image-to-Image Translation with Conditional Adversarial Networks
- Generative Visual Manipulation on the Natural Image Manifold
- Generative Adversarial Text to Image Synthesis
- Radiomics: Images Are More than Pictures, They Are Data
- U-Net: Convolutional Networks for Biomedical Image Segmentation
- Deep Unsupervised Learning using Nonequilibrium Thermodynamics
- Adam: A Method for Stochastic Optimization
- The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)
Related