Mango-GS: Enhancing Spatio-Temporal Consistency in Dynamic Scenes Reconstruction using Multi-Frame Node-Guided 4D Gaussian Splatting
Tingxuan Huang, Haowei Zhu, Jun-Hai Yong, Hao Pan, Bin Wang
摘要
Reconstructing dynamic 3D scenes with photorealistic detail and strong temporal coherence remains a significant challenge. Existing Gaussian splatting approaches for dynamic scene modeling often rely on per-frame optimization, which can overfit to instantaneous states instead of capturing underlying motion dynamics. To address this, we present Mango-GS, a multi-frame, node-guided framework for high-fidelity 4D reconstruction. Mango-GS leverages a temporal Transformer to model motion dependencies within a short window of frames, producing temporally consistent deformations. For efficiency, temporal modeling is confined to a sparse set of control nodes. Each node is represented by a decoupled canonical position and a latent code, providing a stable semantic anchor for motion propagation and preventing correspondence drift under large motion. Our framework is trained end-to-end, enhanced by an input masking strategy and two multi-frame losses to improve robustness. Extensive experiments demonstrate that Mango-GS achieves state-of-the-art reconstruction quality and real-time rendering speed, enabling high-fidelity reconstruction and interactive rendering of dynamic scenes. Code is available at https://github.com/htx0601/Mango-GS .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper33
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 被引用 4,089 次
- Nerfies: Deformable Neural Radiance FieldsKeunhong Park, Utkarsh Sinha, Jonathan T. Barron, Sofien Bouaziz 等ICCV 2021 · 被引用 1,442 次
- Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian SplattingZeyu Yang, Hongye Yang, Zijie Pan, Li ZhangICLR 2024 · 被引用 529 次
- 4D Gaussian Splatting for Real-Time Dynamic Scene RenderingGuanjun Wu, Taoran Yi, Jiemin Fang, Lingxi Xie 等CVPR 2024 · 被引用 513 次
相关 Paper
- MCGS: Markov Chain Gaussian Splatting for Dynamic Scenes ReconstructionYuzhong Wang, Wenmin Wang, Shixiong Zhang, Xinxing Yu 等AAAI 2026 · 被引用 1 次
- MoRGS: Efficient Per-Gaussian Motion Reasoning for Streamable Dynamic 3D ScenesWonjoon Lee, Sungmin Woo, Donghyeong Kim, Jungho Lee 等CVPR 2026 · 被引用 2 次
- Orientation-anchored Hyper-Gaussian for 4D Reconstruction from Casual VideosJunyi Wu, Jiachen Tao, Haoxuan Wang, Gaowen Liu 等NeurIPS 2025 · 被引用 9 次
- TagSplat: Topology-Aware Gaussian Splatting for Dynamic Mesh Modeling and TrackingHanzhi Guo, Dongdong Weng, Mo Su, Yixiao Chen 等CVPR 2026 · 被引用 1 次
- Motion Decoupled 3D Gaussian Splatting for Dynamic Object RepresentationXiao Hu, Libo Long, Jochen LangAAAI 2025 · 被引用 2 次
