vix.ing · top · new · best · stats · spec

Scalable Normalizing Flows for Permutation Invariant Densities

2020/10/07 by Marin Biloš, Stephan Günnemann, Biloš, Marin +1 · 1 citation
Computer Science · #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification

paper · pdf · doi:10.48550/arxiv.2010.03242

openalex publication_date 2020/10/07 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Modeling sets is an important problem in machine learning since this type of data can be found in many domains. A promising approach defines a family of permutation invariant densities with continuous normalizing flows. This allows us to maximize the likelihood directly and sample new realizations with ease. In this work, we demonstrate how calculating the trace, a crucial step in this method, raises issues that occur both during training and inference, limiting its practicality. We propose an alternative way of defining permutation equivariant transformations that give closed form trace. This leads not only to improvements while training, but also to better final performance. We demonstrate the benefits of our approach on point processes and general set modeling.

Cited by

Related