Progressively Optimized Local Radiance Fields for Robust View Synthesis
Andreas Meuleman, Yu-Lun Liu, Chen Gao, Jia-Bin Huang, Changil Kim, Min H. Kim, Johannes Kopf
Abstract
Input: casually captured long video Output: jointly estimated camera poses and local radiance fields LocalRF (ours): high-quality novel view synthesis BARF [17]: the estimated poses often fall into local minima for long sequences Mip-NeRF360 [4]: the spatial resolution is often limited throughout the video Figure 1 . High-quality novel view synthesis from a long casually captured video. We jointly optimize camera poses and a scene representation using a progressive scheme that dynamically allocates local radiance fields (blue boxes). Our method robustly handles casual hand-held captures, scales to processing arbitrarily long videos with limited memory usage, and maintains high resolution throughout the entire video.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1b7b0069-de60-44bb-954b-08bc8700d456Cited by top-tier papers55
- A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large DatasetsBernhard Kerbl, Andreas Meuleman, Georgios Kopanas, Michael Wimmer et al.SIGGRAPH 2024 · 180 citations
- DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving ScenesXiaoyu Zhou, Zhiwei Lin, Xiaojun Shan, Yongtao Wang et al.CVPR 2024 · 166 citations
- LU-NeRF: Scene and Pose Estimation by Synchronizing Local Unposed NeRFsZezhou Cheng, Carlos Esteves, Varun Jampani, Abhishek Kar et al.ICCV 2023 · 46 citations
- SMERF: Streamable Memory Efficient Radiance Fields for Real-Time Large-Scene ExplorationDaniel Duckworth, Peter Hedman, Christian Reiser, Peter Zhizhin et al.SIGGRAPH 2024 · 41 citations
- A Construct-Optimize Approach to Sparse View Synthesis without Camera PoseKaiwen Jiang, Yang Fu, Mukund Varma T., Yash Belhe et al.SIGGRAPH 2024 · 20 citations
Builds on22
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- Vision Transformers for Dense PredictionRené Ranftl, Alexey Bochkovskiy, Vladlen KoltunICCV 2021 · 2,647 citations
- Digging Into Self-Supervised Monocular Depth EstimationClément Godard, Oisin Mac Aodha, Michael Firman, Gabriel J. BrostowICCV 2019 · 2,416 citations
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan et al.CVPR 2022 · 1,603 citations
- Plenoxels: Radiance Fields without Neural NetworksSara Fridovich-Keil, Alex Yu, Matthew Tancik, Qinhong Chen et al.CVPR 2022 · 1,237 citations
Related papers
- SPARF: Neural Radiance Fields from Sparse and Noisy PosesPrune Truong, Marie-Julie Rakotosaona, Fabian Manhardt, Federico TombariCVPR 2023
- BARF: Bundle-Adjusting Neural Radiance FieldsChen-Hsuan Lin, Wei-Chiu Ma, Antonio Torralba, Simon LuceyICCV 2021 · 867 citations
- GNeRF: GAN-based Neural Radiance Field without Posed CameraQuan Meng, Anpei Chen, Haimin Luo, Minye Wu et al.ICCV 2021 · 222 citations
- HumanRF: High-Fidelity Neural Radiance Fields for Humans in MotionMustafa Isik, Martin Rünz, Markos Georgopoulos, Taras Khakhulin et al.SIGGRAPH 2023 · 149 citations
- Casual3DHDR: High Dynamic Range 3D Gaussian Splatting from Casually Captured VideosShucheng Gong, Lingzhe Zhao, Wenpu Li, Hong Xie et al.ACM MM 2025 · 2 citations
