MU-GeNeRF: Multi-view Uncertainty-guided Generalizable Neural Radiance Fields for Distractor-aware Scene
Wenjie Mu, Zhan Li, Chuanzhou Su, Xuanyi Shen, Ziniu Liu, Fan Lu, Yujian Mo, Junqiao Zhao, Tiantian Feng, Chen Ye, Guang Chen
Abstract
Generalizable Neural Radiance Fields (GeNeRFs) enable high-quality scene reconstruction from sparse views and can generalize to unseen scenes. However, in real-world settings, transient distractors break cross-view structural consistency, corrupting supervision and degrading reconstruction quality. Existing distractor-free NeRF methods rely on per-scene optimization and estimate uncertainty from per-view reconstruction errors, which are not reliable for GeNeRFs and often misjudge inconsistent static structures as distractors. To this end, we propose MU-GeNeRF, a Multi-view Uncertainty-guided distractoraware GeNeRF framework designed to alleviate GeNeRF's robust modeling challenges in the presence of transient distractions. We decompose distractor awareness into two complementary uncertainty components: Source-view Uncertainty, which captures structural discrepancies across source views caused by viewpoint changes or dynamic factors; and Target-view Uncertainty, which detects observation anomalies in the target image induced by transient distractors. These two uncertainties address distinct error sources and are combined through a heteroscedastic reconstruction loss, which guides the model to adaptively modulate supervision, enabling more robust distractor suppression and geometric modeling. Extensive experiments show that our method not only surpasses existing GeN-eRFs but also achieves performance comparable to scenespecific distractor-free NeRFs. Project page: https: //github.com/Yanyilucas/MU-GeNeRF.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 490b531c-e7ec-44f9-8167-1dd1ef694300Builds on33
- MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View StereoAnpei Chen, Zexiang Xu, Fuqiang Zhao, Xiaoshuai Zhang et al.ICCV 2021 · 1,024 citations
- Block-NeRF: Scalable Large Scene Neural View SynthesisMatthew Tancik, Vincent Casser, Xinchen Yan, Sabeek Pradhan et al.CVPR 2022 · 702 citations
- Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly- ThroughsHaithem Turki, Deva Ramanan, Mahadev SatyanarayananCVPR 2022 · 364 citations
- Hallucinated Neural Radiance Fields in the WildXingyu Chen, Qi Zhang, Xiaoyu Li, Yue Chen et al.CVPR 2022 · 111 citations
- Neural 3D Reconstruction in the WildJiaming Sun, Xi Chen, Qianqian Wang, Zhengqi Li et al.SIGGRAPH 2022 · 107 citations
Related papers
- RobustNeRF: Ignoring Distractors with Robust LossesSara Sabour, Suhani Vora, Daniel Duckworth, Ivan Krasin et al.CVPR 2023
- NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the WildWeining Ren, Zihan Zhu, Boyang Sun, Jiaqi Chen et al.CVPR 2024 · 31 citations
- NeRF-HuGS: Improved Neural Radiance Fields in Non-static Scenes Using Heuristics-Guided SegmentationJiahao Chen, Yipeng Qin, Lingjie Liu, Jiangbo Lu et al.CVPR 2024
- PruNeRF: Segment-Centric Dataset Pruning via 3D Spatial ConsistencyYeonsung Jung, Heecheol Yun, Joonhyung Park, Jin-Hwa Kim et al.ICML 2024 · 3 citations
- GM-NeRF: Learning Generalizable Model-Based Neural Radiance Fields from Multi-View ImagesJianchuan Chen, Wentao Yi, Liqian Ma, Xu Jia et al.CVPR 2023
