vix.ing · top · new · best · stats · spec

Synthesizing 3D Abstractions by Inverting Procedural Buildings with Transformers

2025/01/28 by Maximilian Dax, Max Dax, Dax, Maximilian +8 · 1 voice
Engineering · #Architecture and Computational Design #Modular Robots and Swarm Intelligence #cs.AI #cs.CV #cs.LG

paper · pdf · doi:10.48550/arxiv.2501.17044

openalex publication_date 2025/01/28 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We generate abstractions of buildings, reflecting the essential aspects of their geometry and structure, by learning to invert procedural models. We first build a dataset of abstract procedural building models paired with simulated point clouds and then learn the inverse mapping through a transformer. Given a point cloud, the trained transformer then infers the corresponding abstracted building in terms of a programmatic language description. This approach leverages expressive procedural models developed for gaming and animation, and thereby retains desirable properties such as efficient rendering of the inferred abstractions and strong priors for regularity and symmetry. Our approach achieves good reconstruction accuracy in terms of geometry and structure, as well as structurally consistent inpainting.

Discussions

Related