Robust Dynamic Radiance Fields
Yu-Lun Liu, Chen Gao, Andreas Meuleman, Hung-Yu Tseng, Ayush Saraf, Changil Kim, Yung-Yu Chuang, Johannes Kopf, Jia-Bin Huang
Abstract
https://robust-dynrf.github.io/ Figure 1 . Robust space-time synthesis from dynamic monocular videos. Our method takes a casually captured video as input and reconstructs the camera trajectory and dynamic radiance fields. Conventional SfM system such as COLMAP fails to recover camera poses even when using ground truth motion masks. As a result, existing dynamic radiance field methods that require accurate pose estimation do not work on these challenging dynamic scenes. Our work tackles this robustness problem and showcases high-fidelity dynamic view synthesis results on a wide variety of videos.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 18c7d558-75ac-4c97-9c0f-68ee33e17d2bCited by top-tier papers121
- 4D Gaussian Splatting for Real-Time Dynamic Scene RenderingGuanjun Wu, Taoran Yi, Jiemin Fang, Lingxi Xie et al.CVPR 2024 · 513 citations
- DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving ScenesXiaoyu Zhou, Zhiwei Lin, Xiaojun Shan, Yongtao Wang et al.CVPR 2024 · 166 citations
- MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian SplattingRuijie Zhu, Yanzhe Liang, Hanzhi Chang, Jiacheng Deng et al.NeurIPS 2024 · 87 citations
- DreamScene4D: Dynamic Multi-Object Scene Generation from Monocular VideosWen-Hsuan Chu, Lei Ke, Katerina FragkiadakiNeurIPS 2024 · 75 citations
- Grid4D: 4D Decomposed Hash Encoding for High-Fidelity Dynamic Gaussian SplattingJiawei Xu, Zexin Fan, Jian Yang, Jin XieNeurIPS 2024 · 64 citations
Builds on28
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman et al.ICCV 2021 · 2,700 citations
- Digging Into Self-Supervised Monocular Depth EstimationClément Godard, Oisin Mac Aodha, Michael Firman, Gabriel J. BrostowICCV 2019 · 2,416 citations
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan et al.CVPR 2022 · 1,603 citations
- Nerfies: Deformable Neural Radiance FieldsKeunhong Park, Utkarsh Sinha, Jonathan T. Barron, Sofien Bouaziz et al.ICCV 2021 · 1,442 citations
Related papers
- DyBluRF: Dynamic Neural Radiance Fields from Blurry Monocular VideoHuiqiang Sun, Xingyi Li, Liao Shen, Xinyi Ye et al.CVPR 2024 · 5 citations
- RGB-Only Supervised Camera Parameter Optimization in Dynamic ScenesFang Li, Hao Zhang, Narendra AhujaNeurIPS 2025
- Progressively Optimized Local Radiance Fields for Robust View SynthesisAndreas Meuleman, Yu-Lun Liu, Chen Gao, Jia-Bin Huang et al.CVPR 2023
- S-DyRF: Reference-Based Stylized Radiance Fields for Dynamic ScenesXingyi Li, Zhiguo Cao, Yizheng Wu, Kewei Wang et al.CVPR 2024
- Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic ScenesZhengqi Li, Simon Niklaus, Noah Snavely, Oliver WangCVPR 2021
