MotionScale: Reconstructing Appearance, Geometry, and Motion of Dynamic Scenes with Scalable 4D Gaussian Splatting
Haoran Zhou, Gim Hee Lee
摘要
Realistic reconstruction of dynamic 4D scenes is essential for understanding the physical world.Despite recent progress in monocular view synthesis, existing methods still struggle to recover accurate 3D geometry and temporally consistent motion in complex environments.To address these challenges, we propose MotionScale, a 4D Gaussian Splatting framework that scales efficiently to large scenes and extended sequences, enabling faithful reconstruction of high-fidelity scene structures and coherent motion representation under complex dynamics.To handle motion with arbitrary flexibility and long-term variation, we introduce a scalable motion field built upon cluster-based bases that adaptively grow to capture diverse motion patterns over time.Moreover, we introduce a progressive optimization strategy that extends naturally to unseen frames. This strategy comprises two propagation modules: 1) A background module that adapts to newly appearing objects, refines camera poses, and accounts for shadows; 2) A foreground module that refines motion through a three-stage process.Extensive experiments on challenging real-world datasets demonstrate that our MotionScale achieves superior reconstruction quality and motion consistency that significantly outperform prior 4D scene reconstruction methods.Our code will be open-sourced on paper acceptance.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper29
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao 等ICCV 2023 · 被引用 13,211 次
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 被引用 4,089 次
- Depth Anything V2Lihe Yang, Bingyi Kang, Zilong Huang, Zhen Zhao 等NeurIPS 2024 · 被引用 2,305 次
- Nerfies: Deformable Neural Radiance FieldsKeunhong Park, Utkarsh Sinha, Jonathan T. Barron, Sofien Bouaziz 等ICCV 2021 · 被引用 1,442 次
相关 Paper
- Motion Decoupled 3D Gaussian Splatting for Dynamic Object RepresentationXiao Hu, Libo Long, Jochen LangAAAI 2025 · 被引用 2 次
- Uncertainty Matters in Dynamic Gaussian Splatting for Monocular 4D ReconstructionFengzhi Guo, Chih-Chuan Hsu, Sihao Ding, Cheng ZhangICLR 2026 · 被引用 6 次
- Motion4D: Learning 3D-Consistent Motion and Semantics for 4D Scene UnderstandingHaoran Zhou, Gim Hee LeeNeurIPS 2025 · 被引用 3 次
- Space-Time Forecasting of Dynamic Scenes with Motion-aware Gaussian GroupingJunmyeong Lee, Hoseung Choi, Minsu ChoCVPR 2026 · 被引用 3 次
- MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion ScaffoldsJiahui Lei, Yijia Weng, Adam W. Harley, Leonidas J. Guibas 等CVPR 2025
