vix.ing · top · new · best · stats · spec

Investigating Data Memorization in 3D Latent Diffusion Models for Medical Image Synthesis

2023/07/03 by Salman Ul Hassan Dar, Arman Ghanaat, Dar, Salman Ul Hassan +10 · 3 citations
Computer Science · #AI in cancer detection #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Generative Adversarial Networks and Image Synthesis #Image and Video Processing (eess.IV) #Machine Learning in Healthcare #electronic engineering #information engineering

paper · pdf · doi:10.48550/arxiv.2307.01148

openalex publication_date 2023/07/03 · openalex created_date 2023/07/05 · openalex updated_date 2026/08/01

Abstract

Generative latent diffusion models have been established as state-of-the-art in data generation. One promising application is generation of realistic synthetic medical imaging data for open data sharing without compromising patient privacy. Despite the promise, the capacity of such models to memorize sensitive patient training data and synthesize samples showing high resemblance to training data samples is relatively unexplored. Here, we assess the memorization capacity of 3D latent diffusion models on photon-counting coronary computed tomography angiography and knee magnetic resonance imaging datasets. To detect potential memorization of training samples, we utilize self-supervised models based on contrastive learning. Our results suggest that such latent diffusion models indeed memorize training data, and there is a dire need for devising strategies to mitigate memorization.

Cited by

Related