NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wild
Weining Ren, Zihan Zhu, Boyang Sun, Jiaqi Chen, Marc Pollefeys, Songyou Peng
Abstract
Neural Radiance Fields (NeRFs) have shown remarkable success in synthesizing photorealistic views from multi-view images of static scenes, but face challenges in dynamic, real-world environments with distractors like moving objects, shadows, and lighting changes. Existing methods manage controlled environments and low occlusion ra-tios but fall short in render quality, especially under high occlusion scenarios. In this paper, we introduce NeRF On-the-go, a simple yet effective approach that enables the ro-bust synthesis of novel views in complex, in-the-wild scenes from only casually captured image sequences. Delving into uncertainty, our method not only efficiently eliminates dis-tractors, even when they are predominant in captures, but also achieves a notably faster convergence speed. Through comprehensive experiments on various scenes, our method demonstrates a significant improvement over state-of-the-art techniques. This advancement opens new avenues for NeRF in diverse and dynamic real-world applications.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext df11690b-95cf-4d7f-b549-a9107a0a6b5dCited by top-tier papers43
- WildGaussians: 3D Gaussian Splatting In the WildJonas Kulhanek, Songyou Peng, Zuzana Kukelova, Marc Pollefeys et al.NeurIPS 2024 · 202 citations
- DeRainGS: Gaussian Splatting for Enhanced Scene Reconstruction in Rainy EnvironmentsShuhong Liu, Xiang Chen, Hongming Chen, Quanfeng Xu et al.AAAI 2025 · 25 citations
- Emergent Outlier View Rejection in Visual Geometry Grounded TransformersJisang Han, Sunghwan Hong, Jaewoo Jung, Wooseok Jang et al.CVPR 2026 · 19 citations
- GaussianUpdate: Continual 3D Gaussian Splatting Update for Changing EnvironmentsLin Zeng, Boming Zhao, Jiarui Hu, Xujie Shen et al.ICCV 2025 · 14 citations
- OccFusion: Rendering Occluded Humans with Generative Diffusion PriorsAdam Sun, Tiange Xiang, Scott L. Delp, Li Fei-Fei et al.NeurIPS 2024 · 13 citations
Builds on24
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan et al.CVPR 2022 · 1,603 citations
- DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D CamerasZachary Teed, Jia DengNeurIPS 2021 · 1,248 citations
- GRAF: Generative Radiance Fields for 3D-Aware Image SynthesisKatja Schwarz, Yiyi Liao, Michael Niemeyer, Andreas GeigerNeurIPS 2020 · 1,001 citations
- Block-NeRF: Scalable Large Scene Neural View SynthesisMatthew Tancik, Vincent Casser, Xinchen Yan, Sabeek Pradhan et al.CVPR 2022 · 702 citations
Related papers
- RobustNeRF: Ignoring Distractors with Robust LossesSara Sabour, Suhani Vora, Daniel Duckworth, Ivan Krasin et al.CVPR 2023
- NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo CollectionsRicardo Martin-Brualla, Noha Radwan, Mehdi S. M. Sajjadi, Jonathan T. Barron et al.CVPR 2021
- MU-GeNeRF: Multi-view Uncertainty-guided Generalizable Neural Radiance Fields for Distractor-aware SceneWenjie Mu, Zhan Li, Chuanzhou Su, Xuanyi Shen et al.CVPR 2026
- NeRF-MS: Neural Radiance Fields with Multi-SequencePeihao Li, Shaohui Wang, Chen Yang, Bingbing Liu et al.ICCV 2023 · 22 citations
- NeRF-HuGS: Improved Neural Radiance Fields in Non-static Scenes Using Heuristics-Guided SegmentationJiahao Chen, Yipeng Qin, Lingjie Liu, Jiangbo Lu et al.CVPR 2024
