vix.ing · top · new · best · stats · spec

Spot the fake lungs: Generating Synthetic Medical Images using Neural Diffusion Models

2022/11/02 by Hazrat Ali, Ali, Hazrat, Shafaq Murad +3 · 4 citations
Computer Science · #AI in cancer detection #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Generative Adversarial Networks and Image Synthesis #Image and Video Processing (eess.IV) #Machine Learning (cs.LG) #Machine Learning in Healthcare #electronic engineering #information engineering

paper · pdf · doi:10.48550/arxiv.2211.00902

openalex publication_date 2022/11/02 · openalex created_date 2022/11/08 · openalex updated_date 2026/07/28

Abstract

Generative models are becoming popular for the synthesis of medical images. Recently, neural diffusion models have demonstrated the potential to generate photo-realistic images of objects. However, their potential to generate medical images is not explored yet. In this work, we explore the possibilities of synthesis of medical images using neural diffusion models. First, we use a pre-trained DALLE2 model to generate lungs X-Ray and CT images from an input text prompt. Second, we train a stable diffusion model with 3165 X-Ray images and generate synthetic images. We evaluate the synthetic image data through a qualitative analysis where two independent radiologists label randomly chosen samples from the generated data as real, fake, or unsure. Results demonstrate that images generated with the diffusion model can translate characteristics that are otherwise very specific to certain medical conditions in chest X-Ray or CT images. Careful tuning of the model can be very promising. To the best of our knowledge, this is the first attempt to generate lungs X-Ray and CT images using neural diffusion models. This work aims to introduce a new dimension in artificial intelligence for medical imaging. Given that this is a new topic, the paper will serve as an introduction and motivation for the research community to explore the potential of diffusion models for medical image synthesis. We have released the synthetic images on https://www.kaggle.com/datasets/hazrat/awesomelungs.

Cited by

Related