NerfAcc: Efficient Sampling Accelerates NeRFs
Ruilong Li, Hang Gao, Matthew Tancik, Angjoo Kanazawa
Abstract
Optimizing and rendering Neural Radiance Fields is computationally expensive due to the vast number of samples required by volume rendering. Recent works have included alternative sampling approaches to help accelerate their methods, however, they are often not the focus of the work. In this paper, we investigate and compare multiple sampling approaches and demonstrate that improved sampling is generally applicable across NeRF variants under an unified concept of transmittance estimator. To facilitate future experiments, we develop NerfAcc, a Python toolbox that provides flexible APIs for incorporating advanced sampling methods into NeRF related methods. We demonstrate its flexibility by showing that it can reduce the training time of several recent NeRF methods by 1.5× to 20× with minimal modifications to the existing codebase. Additionally, highly customized NeRFs, such as Instant-NGP, can be implemented in native PyTorch using NerfAcc. Our code are open-sourced at https://www.nerfacc.com .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers19
- Mip-Splatting: Alias-Free 3D Gaussian SplattingZehao Yu, Anpei Chen, Binbin Huang, Torsten Sattler et al.CVPR 2024 · 360 citations
- 4Diffusion: Multi-view Video Diffusion Model for 4D GenerationHaiyu Zhang, Xinyuan Chen, Yaohui Wang, Xihui Liu et al.NeurIPS 2024 · 119 citations
- GPS-Gaussian: Generalizable Pixel-Wise 3D Gaussian Splatting for Real-Time Human Novel View SynthesisShunyuan Zheng, Boyao Zhou, Ruizhi Shao, Boning Liu et al.CVPR 2024 · 79 citations
- HDR-GS: Efficient High Dynamic Range Novel View Synthesis at 1000x Speed via Gaussian SplattingYuanhao Cai, Zihao Xiao, Yixun Liang, Minghan Qin et al.NeurIPS 2024 · 48 citations
- fVDB : A Deep-Learning Framework for Sparse, Large Scale, and High Performance Spatial IntelligenceFrancis Williams, Jiahui Huang, Jonathan Swartz, Gergely Klár et al.SIGGRAPH 2024 · 25 citations
Builds on17
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman et al.ICCV 2021 · 2,700 citations
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view ReconstructionPeng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt et al.NeurIPS 2021 · 2,500 citations
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan et al.CVPR 2022 · 1,603 citations
- Nerfies: Deformable Neural Radiance FieldsKeunhong Park, Utkarsh Sinha, Jonathan T. Barron, Sofien Bouaziz et al.ICCV 2021 · 1,442 citations
Related papers
- EfficientNeRF - Efficient Neural Radiance FieldsTao Hu, Shu Liu, Yilun Chen, Tiancheng Shen et al.CVPR 2022 · 132 citations
- A General Implicit Framework for Fast NeRF Composition and RenderingXinyu Gao, Ziyi Yang, Yunlu Zhao, Yuxiang Sun et al.AAAI 2024 · 6 citations
- Nerfstudio: A Modular Framework for Neural Radiance Field DevelopmentMatthew Tancik, Ethan Weber, Evonne Ng, Ruilong Li et al.SIGGRAPH 2023 · 592 citations
- Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan et al.ICCV 2023 · 799 citations
- Efficient View Synthesis with Neural Radiance Distribution FieldYushuang Wu, Xiao Li, Jinglu Wang, Xiaoguang Han et al.ICCV 2023 · 2 citations
