vix.ing · top · new · best · stats · spec

F-scheduler: illuminating the free-lunch design space for fast sampling of diffusion models

2025/09/30 by Zilai Li, Li, Zilai, Bai, Lujia
Computer Science · Medicine · #Advanced Neuroimaging Techniques and Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Electrical engineering #Generative Adversarial Networks and Image Synthesis #Graphics (cs.GR) #Image and Video Processing (eess.IV) #Medical Image Segmentation Techniques #electronic engineering #information engineering

paper · pdf · doi:10.48550/arxiv.2510.02390

openalex publication_date 2025/09/30 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/30

Abstract

Diffusion models are the state-of-the-art generative models for high-resolution images, but sampling from pretrained models is computationally expensive, motivating interest in fast sampling. Although Free-U Net is a training-free enhancement for improving image quality, we find it ineffective under few-step (<10) sampling. We analyze the discrete diffusion ODE and propose F-scheduler, a scheduler designed for ODE solvers with Free-U Net. Our proposed scheduler consists of a special time schedule that does not fully denoise the feature to enable the use of the KL-term in the β-VAE decoder, and the schedule of a proper inference stage for modifying the U-Net skip-connection via Free-U Net. Via information theory, we provide insights into how the better scheduled ODE solvers for the diffusion model can outperform the training-based diffusion distillation model. The newly proposed scheduler is compatible with most of the few-step ODE solvers and can sample a 1024 x 1024-resolution image in 6 steps and a 512 x 512-resolution image in 5 steps when it applies to DPM++ 2m and UniPC, with an FID result that outperforms the SOTA distillation models and the 20-step DPM++ 2m solver, respectively. Codebase: https://github.com/TheLovesOfLadyPurple/F-scheduler

Citations

Related