vix.ing · top · new · best · stats · spec

Filter-adapted spatiotemporal sampling for real-time rendering

2023/10/23 by William Donnelly, Alan Wolfe, Donnelly, William +5
Computer Science · #Advanced Image Processing Techniques #Advanced Vision and Imaging #Computer Graphics and Visualization Techniques #FOS: Computer and information sciences #Graphics (cs.GR) #I.3.3 #I.3.7 #cs.GR

paper · pdf · doi:10.48550/arxiv.2310.15364

published as Proc. ACM Comput. Graph. Interact. Tech., Vol. 7, No. 1, Art. 13, pp. 1-16 (2024) · 18 pages, 12 figures

arxiv created 2023/10/23 · openalex publication_date 2023/10/23 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28 · arxiv updated 2026/08/04

Abstract

Stochastic sampling techniques are ubiquitous in real-time rendering, where performance constraints force the use of low sample counts, leading to noisy intermediate results. To remove this noise, the post-processing step of temporal and spatial denoising is an integral part of the real-time graphics pipeline. The main insight presented in this paper is that we can optimize the samples used in stochastic sampling such that the post-processing error is minimized. The core of our method is an analytical loss function which measures post-filtering error for a class of integrands - multidimensional Heaviside functions. These integrands are an approximation of the discontinuous functions commonly found in rendering. Our analysis applies to arbitrary spatial and spatiotemporal filters, scalar and vector sample values, and uniform and non-uniform probability distributions. We show that the spectrum of Monte Carlo noise resulting from our sampling method is adapted to the shape of the filter, resulting in less noisy final images. We demonstrate improvements over state-of-the-art sampling methods in three representative rendering tasks: ambient occlusion, volumetric ray-marching, and color image dithering. Common use noise textures, and noise generation code is available at https://github.com/electronicarts/fastnoise.

Related