vix.ing · top · new · best · stats · spec

Exponential Tilting of Generative Models: Improving Sample Quality by Training and Sampling from Latent Energy

2020/06/15 by Zhisheng Xiao, Xiao, Zhisheng, Qing Yan +3
Computer Science · #Computer Graphics and Visualization Techniques #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Music and Audio Processing

paper · pdf · doi:10.48550/arxiv.2006.08100

openalex publication_date 2020/06/15 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

In this paper, we present a general method that can improve the sample quality of pre-trained likelihood based generative models. Our method constructs an energy function on the latent variable space that yields an energy function on samples produced by the pre-trained generative model. The energy based model is efficiently trained by maximizing the data likelihood, and after training, new samples in the latent space are generated from the energy based model and passed through the generator to producing samples in observation space. We show that using our proposed method, we can greatly improve the sample quality of popular likelihood based generative models, such as normalizing flows and VAEs, with very little computational overhead.

Citations

Related