vix.ing · top · new · best · stats · spec

Efficient inference in occlusion-aware generative models of images

2015/11/19 by Jonathan Huang, Kevin Murphy, Huang, Jonathan +1 · 4 citations
Computer Science · #Advanced Vision and Imaging #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #cs.CV #cs.LG

paper · pdf · doi:10.48550/arxiv.1511.06362

10 pages

openalex publication_date 2015/11/19 · arxiv created 2016/02/16 · arxiv updated 2016/02/17 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We present a generative model of images based on layering, in which image layers are individually generated, then composited from front to back. We are thus able to factor the appearance of an image into the appearance of individual objects within the image --- and additionally for each individual object, we can factor content from pose. Unlike prior work on layered models, we learn a shape prior for each object/layer, allowing the model to tease out which object is in front by looking for a consistent shape, without needing access to motion cues or any labeled data. We show that ordinary stochastic gradient variational bayes (SGVB), which optimizes our fully differentiable lower-bound on the log-likelihood, is sufficient to learn an interpretable representation of images. Finally we present experiments demonstrating the effectiveness of the model for inferring foreground and background objects in images.

Citations

Cited by

Related