vix.ing · top · new · best · stats · spec

Stochastic Gradient Estimation for Higher-order Differentiable Rendering

2024/12/04 by Zican, Wang, Zican, Michael A. Fischer +3
Computer Science · Engineering · #3D Modeling in Geospatial Applications #3D Shape Modeling and Analysis #Computer Graphics and Visualization Techniques #FOS: Computer and information sciences #Graphics (cs.GR)

paper · pdf · doi:10.48550/arxiv.2412.03489

openalex publication_date 2024/12/04 · openalex created_date 2024/12/06 · openalex updated_date 2026/07/28

Abstract

We derive methods to compute higher order differentials (Hessians and Hessian-vector products) of the rendering operator. Our approach is based on importance sampling of a convolution that represents the differentials of rendering parameters and shows to be applicable to both rasterization and path tracing. We further suggest an aggregate sampling strategy to importance-sample multiple dimensions of one convolution kernel simultaneously. We demonstrate that this information improves convergence when used in higher-order optimizers such as Newton or Conjugate Gradient relative to a gradient descent baseline in several inverse rendering tasks.

Related