Unbiased inverse volume rendering with differential trackers
Merlin Nimier-David, Thomas Müller, Alexander Keller, Wenzel Jakob
Abstract
Volumetric representations are popular in inverse rendering because they have a simple parameterization, are smoothly varying, and transparently handle topology changes. However, incorporating the full volumetric transport of light is costly and challenging, often leading practitioners to implement simplified models, such as purely emissive and absorbing volumes with "baked" lighting. One such challenge is the efficient estimation of the gradients of the volume's appearance with respect to its scattering and absorption parameters. We show that the straightforward approach---differentiating a volumetric free-flight sampler---can lead to biased and high-variance gradients, hindering optimization. Instead, we propose using a new sampling strategy: differential ratio tracking , which is unbiased, yields low-variance gradients, and runs in linear time. Differential ratio tracking combines ratio tracking and reservoir sampling to estimate gradients by sampling distances proportional to the unweighted transmittance rather than the usual extinction-weighted transmittance. In addition, we observe local minima when optimizing scattering parameters to reproduce dense volumes or surfaces. We show that these local minima can be overcome by bootstrapping the optimization from nonphysical emissive volumes that are easily optimized.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fa7eaa23-d85c-4af7-9e7e-5fb5ce02d856Cited by top-tier papers10
- NeMF: Inverse Volume Rendering with Neural Microflake FieldYoujia Zhang, Teng Xu, Junqing Yu, Yuteng Ye et al.ICCV 2023 · 38 citations
- Dynamic Mesh-Aware Radiance FieldsYi-Ling Qiao, Alexander Gao, Yiran Xu, Yue Feng et al.ICCV 2023 · 32 citations
- Objects as Volumes: A Stochastic Geometry View of Opaque SolidsBailey Miller, Hanyu Chen, Alice Lai, Ioannis GkioulekasCVPR 2024 · 8 citations
- Conditional Mixture Path Guiding for Differentiable RenderingZhimin Fan, Pengcheng Shi, Mufan Guo, Ruoyu Fu et al.SIGGRAPH 2024 · 7 citations
- Radiance Surfaces: Optimizing Surface Representations with a 5D Radiance Field LossZiyi Zhang, Nicolas Roussel, Thomas Müller, Tizian Zeltner et al.SIGGRAPH 2025 · 4 citations
Builds on19
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman et al.ICCV 2021 · 2,700 citations
- Volume Rendering of Neural Implicit SurfacesLior Yariv, Jiatao Gu, Yoni Kasten, Yaron LipmanNeurIPS 2021 · 1,421 citations
- Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields ReconstructionCheng Sun, Min Sun, Hwann-Tzong ChenCVPR 2022 · 859 citations
- FastNeRF: High-Fidelity Neural Rendering at 200FPSStephan J. Garbin, Marek Kowalski, Matthew Johnson, Jamie Shotton et al.ICCV 2021 · 778 citations
Related papers
- Sample Matching for Joint Extinction Gradient Estimation in Differentiable Volume RenderingRuihan Yu, Yuchen Wang, Jingwang Ling, Feng Xu et al.SIGGRAPH 2026
- Parameter-space ReSTIR for Differentiable and Inverse RenderingWesley Chang, Venkataram Sivaram, Derek Nowrouzezahrai, Toshiya Hachisuka et al.SIGGRAPH 2023 · 20 citations
- Monte Carlo estimators for differential light transportTizian Zeltner, Sébastien Speierer, Iliyan Georgiev, Wenzel JakobSIGGRAPH 2021 · 70 citations
- Radiative backpropagation: an adjoint method for lightning-fast differentiable renderingMerlin Nimier-David, Sébastien Speierer, Benoît Ruiz, Wenzel JakobSIGGRAPH 2020 · 107 citations
- James-Stein Gradient Combiner for Inverse Monte Carlo RenderingJeongmin Gu, Bochang MoonSIGGRAPH 2025 · 1 citation
