DIVeR: Real-time and Accurate Neural Radiance Fields with Deterministic Integration for Volume Rendering
Liwen Wu, Jae Yong Lee, Anand Bhattad, Yu-Xiong Wang, David A. Forsyth
Abstract
DIVeR builds on the key ideas of NeRF and its variantsdensity models and volume rendering -to learn 3D object models that can be rendered realistically from small numbers of images. In contrast to all previous NeRF methods, DIVeR uses deterministic rather than stochastic estimates of the volume rendering integral. DIVeR's representation is a voxel based field of features. To compute the volume rendering integral, a ray is broken into intervals, one per voxel; components of the volume rendering integral are estimated from the features for each interval using an MLP, and the components are aggregated. As a result, DIVeR can render thin translucent structures that are missed by other integrators. Furthermore, DIVeR's representation has semantics that is relatively exposed compared to other such methods -moving feature vectors around in the voxel space results in natural edits. Extensive qualitative and quantitative comparisons to current state-of-the-art methods show that DIVeR produces models that (1) render at or above stateof-the-art quality, (2) are very small without being baked, (3) render very fast without being baked, and (4) can be edited in natural ways. Our real-time code is available at: https://github.com/lwwu2/diver-rt
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d1d4cf90-c8a8-4ae5-bd0a-4bd7558d234eCited by top-tier papers33
- NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance FieldsLiangchen Song, Anpei Chen, Zhong Li, Zhang Chen et al.IEEE VR 2023 · 246 citations
- AvatarReX: Real-time Expressive Full-body AvatarsZerong Zheng, Xiaochen Zhao, Hongwen Zhang, Boning Liu et al.SIGGRAPH 2023 · 80 citations
- SceneCraft: Layout-Guided 3D Scene GenerationXiuyu Yang, Yunze Man, Jun-Kun Chen, Yu-Xiong WangNeurIPS 2024 · 58 citations
- Real-Time Neural Rasterization for Large ScenesJeffrey Yunfan Liu, Yun Chen, Ze Yang, Jingkang Wang et al.ICCV 2023 · 46 citations
- ClimateNeRF: Extreme Weather Synthesis in Neural Radiance FieldYuan Li, Zhi-Hao Lin, David A. Forsyth, Jia-Bin Huang et al.ICCV 2023 · 44 citations
Builds on28
- Neural Sparse Voxel FieldsLingjie Liu, Jiatao Gu, Kyaw Zaw Lin, Tat-Seng Chua et al.NeurIPS 2020 · 1,535 citations
- PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human DigitizationShunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Morishima et al.ICCV 2019 · 1,411 citations
- PlenOctrees for Real-time Rendering of Neural Radiance FieldsAlex Yu, Ruilong Li, Matthew Tancik, Hao Li et al.ICCV 2021 · 1,284 citations
- MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View StereoAnpei Chen, Zexiang Xu, Fuqiang Zhao, Xiaoshuai Zhang et al.ICCV 2021 · 1,024 citations
- Multiview Neural Surface Reconstruction by Disentangling Geometry and AppearanceLior Yariv, Yoni Kasten, Dror Moran, Meirav Galun et al.NeurIPS 2020 · 1,010 citations
Related papers
- KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPsChristian Reiser, Songyou Peng, Yiyi Liao, Andreas GeigerICCV 2021 · 963 citations
- Volume Feature Rendering for Fast Neural Radiance Field ReconstructionKang Han, Wei Xiang, Lu YuNeurIPS 2023 · 8 citations
- Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields ReconstructionCheng Sun, Min Sun, Hwann-Tzong ChenCVPR 2022 · 859 citations
- Baking Neural Radiance Fields for Real-Time View SynthesisPeter Hedman, Pratul P. Srinivasan, Ben Mildenhall, Jonathan T. Barron et al.ICCV 2021 · 636 citations
- TriVol: Point Cloud Rendering via Triple VolumesTao Hu, Xiaogang Xu, Ruihang Chu, Jiaya JiaCVPR 2023
