Unbiased inverse volume rendering with differential trackers
Merlin Nimier-David, Thomas Müller, Alexander Keller, Wenzel Jakob
摘要
Volumetric representations are popular in inverse rendering because they have a simple parameterization, are smoothly varying, and transparently handle topology changes. However, incorporating the full volumetric transport of light is costly and challenging, often leading practitioners to implement simplified models, such as purely emissive and absorbing volumes with "baked" lighting. One such challenge is the efficient estimation of the gradients of the volume's appearance with respect to its scattering and absorption parameters. We show that the straightforward approach---differentiating a volumetric free-flight sampler---can lead to biased and high-variance gradients, hindering optimization. Instead, we propose using a new sampling strategy: differential ratio tracking , which is unbiased, yields low-variance gradients, and runs in linear time. Differential ratio tracking combines ratio tracking and reservoir sampling to estimate gradients by sampling distances proportional to the unweighted transmittance rather than the usual extinction-weighted transmittance. In addition, we observe local minima when optimizing scattering parameters to reproduce dense volumes or surfaces. We show that these local minima can be overcome by bootstrapping the optimization from nonphysical emissive volumes that are easily optimized.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper10
- NeMF: Inverse Volume Rendering with Neural Microflake FieldYoujia Zhang, Teng Xu, Junqing Yu, Yuteng Ye 等ICCV 2023 · 被引用 38 次
- Dynamic Mesh-Aware Radiance FieldsYi-Ling Qiao, Alexander Gao, Yiran Xu, Yue Feng 等ICCV 2023 · 被引用 32 次
- Objects as Volumes: A Stochastic Geometry View of Opaque SolidsBailey Miller, Hanyu Chen, Alice Lai, Ioannis GkioulekasCVPR 2024 · 被引用 8 次
- Conditional Mixture Path Guiding for Differentiable RenderingZhimin Fan, Pengcheng Shi, Mufan Guo, Ruoyu Fu 等SIGGRAPH 2024 · 被引用 7 次
- Radiance Surfaces: Optimizing Surface Representations with a 5D Radiance Field LossZiyi Zhang, Nicolas Roussel, Thomas Müller, Tizian Zeltner 等SIGGRAPH 2025 · 被引用 4 次
它引用的顶会 Paper19
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 被引用 4,089 次
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman 等ICCV 2021 · 被引用 2,700 次
- Volume Rendering of Neural Implicit SurfacesLior Yariv, Jiatao Gu, Yoni Kasten, Yaron LipmanNeurIPS 2021 · 被引用 1,421 次
- Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields ReconstructionCheng Sun, Min Sun, Hwann-Tzong ChenCVPR 2022 · 被引用 859 次
- FastNeRF: High-Fidelity Neural Rendering at 200FPSStephan J. Garbin, Marek Kowalski, Matthew Johnson, Jamie Shotton 等ICCV 2021 · 被引用 778 次
相关 Paper
- Sample Matching for Joint Extinction Gradient Estimation in Differentiable Volume RenderingRuihan Yu, Yuchen Wang, Jingwang Ling, Feng Xu 等SIGGRAPH 2026
- Parameter-space ReSTIR for Differentiable and Inverse RenderingWesley Chang, Venkataram Sivaram, Derek Nowrouzezahrai, Toshiya Hachisuka 等SIGGRAPH 2023 · 被引用 20 次
- Monte Carlo estimators for differential light transportTizian Zeltner, Sébastien Speierer, Iliyan Georgiev, Wenzel JakobSIGGRAPH 2021 · 被引用 70 次
- Radiative backpropagation: an adjoint method for lightning-fast differentiable renderingMerlin Nimier-David, Sébastien Speierer, Benoît Ruiz, Wenzel JakobSIGGRAPH 2020 · 被引用 107 次
- James-Stein Gradient Combiner for Inverse Monte Carlo RenderingJeongmin Gu, Bochang MoonSIGGRAPH 2025 · 被引用 1 次
