Moment Bounds are Differentiable: Efficiently Approximating Measures in Inverse Rendering
Markus Worchel, Marc Alexa
Abstract
All rendering methods aim at striking a balance between realism and efficiency. This is particularly relevant for differentiable rendering, where the additional aspect of differentiablity w.r.t. scene parameters causes increased computational complexity while, on the other hand, in the common application of inverse rendering, the diverse effects of real image formation must be faithfully reproduced. An important effect in rendering is the attenuation of light as it travels through different media (visibility, shadows, transmittance, transparency). This can be modeled as an integral over non-negative functions and has been successfully approximated in forward rendering by so-called moments. We show that moment-based approximations are differentiable in the parameters defining the moments, and that this leads to efficient and practical methods for inverse rendering. In particular, we demonstrate the method at the examples of shadow mapping and visibility in volume rendering, leading to approximations that are similar in efficiency to existing ad-hoc techniques while being significantly more accurate.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6c359641-eda8-4ceb-8b3b-2c8c06bad787Builds on21
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view ReconstructionPeng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt et al.NeurIPS 2021 · 2,500 citations
- Volume Rendering of Neural Implicit SurfacesLior Yariv, Jiatao Gu, Yoni Kasten, Yaron LipmanNeurIPS 2021 · 1,421 citations
- Multiview Neural Surface Reconstruction by Disentangling Geometry and AppearanceLior Yariv, Yoni Kasten, Dror Moran, Meirav Galun et al.NeurIPS 2020 · 1,010 citations
- UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View ReconstructionMichael Oechsle, Songyou Peng, Andreas GeigerICCV 2021 · 885 citations
- Soft Rasterizer: A Differentiable Renderer for Image-Based 3D ReasoningShichen Liu, Weikai Chen, Tianye Li, Hao LiICCV 2019 · 789 citations
Related papers
- Efficient and Differentiable Shadow Computation for Inverse ProblemsLinjie Lyu, Marc Habermann, Lingjie Liu, Mallikarjun B. R. et al.ICCV 2021 · 16 citations
- Differentiable Shadow Mapping for Efficient Inverse GraphicsMarkus Worchel, Marc AlexaCVPR 2023
- Path-space differentiable renderingCheng Zhang, Bailey Miller, Kai Yan, Ioannis Gkioulekas et al.SIGGRAPH 2020 · 155 citations
- Differentiable Direct Volume RenderingSebastian Weiss, Rüdiger WestermannIEEE VIS 2021 · 41 citations
- IRGS: Inter-Reflective Gaussian Splatting with 2D Gaussian Ray TracingChun Gu, Xiaofei Wei, Zixuan Zeng, Yuxuan Yao et al.CVPR 2025
