Coverage Optimization for Camera View Selection
Timothy Chen, Adam Dai, Maximilian Adang, Grace Gao, Mac Schwager
Abstract
What makes a good viewpoint? The quality of the data used to learn 3D reconstructions is crucial for enabling efficient and accurate scene modeling. We study the active view selection problem and develop a principled analysis that yields a simple and interpretable criterion for selecting informative camera poses. Our key insight is that informative views can be obtained by minimizing a tractable approximation of the Fisher Information Gain, which reduces to favoring viewpoints that cover geometry that has been insufficiently observed by past cameras. This leads to a lightweight coverage-based view selection metric that avoids expensive transmittance estimation and is robust to noise and training dynamics. We call this metric COVER (Camera Optimization for View Exploration and Reconstruction). We integrate our method into the Nerfstudio framework and evaluate it on real datasets within fixed and embodied data acquisition scenarios. Across multiple datasets and radiance-field baselines, our method consistently improves reconstruction quality compared to state-of-the-art active view selection methods. Additional visualizations and our Nerfstudio package can be found at https://chengine.github.io/nbv_gym/.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4296679a-2181-4f3e-8791-828dbeba6c09Builds on6
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan et al.CVPR 2022 · 1,603 citations
- Nerfstudio: A Modular Framework for Neural Radiance Field DevelopmentMatthew Tancik, Ethan Weber, Evonne Ng, Ruilong Li et al.SIGGRAPH 2023 · 592 citations
- S-NeRF: Neural Radiance Fields for Street ViewsZiyang Xie, Junge Zhang, Wenye Li, Feihu Zhang et al.ICLR 2023 · 13 citations
- Neural Visibility Field for Uncertainty-Driven Active MappingShangjie Xue, Jesse Dill, Pranay Mathur, Frank Dellaert et al.CVPR 2024 · 4 citations
Related papers
- NeRF Director: Revisiting View Selection in Neural Volume RenderingWenhui Xiao, Rodrigo Santa Cruz, David Ahmedt-Aristizabal, Olivier Salvado et al.CVPR 2024 · 12 citations
- Peering into the Unknown: Active View Selection with Neural Uncertainty Maps for 3D ReconstructionZhengquan Zhang, Feng Xu, Mengmi ZhangICLR 2026 · 4 citations
- GO-PRE: Goal-Oriented Next-Best-View Selection via Predictive Rendering Entropy for Active 3D ReconstructionYan Song, Zhihao Li, Chenglong Li, Li He et al.ICML 2026
- Dense Depth Priors for Neural Radiance Fields from Sparse Input ViewsBarbara Roessle, Jonathan T. Barron, Ben Mildenhall, Pratul P. Srinivasan et al.CVPR 2022 · 319 citations
- MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View StereoAnpei Chen, Zexiang Xu, Fuqiang Zhao, Xiaoshuai Zhang et al.ICCV 2021 · 1,024 citations
