Mango-GS: Enhancing Spatio-Temporal Consistency in Dynamic Scenes Reconstruction using Multi-Frame Node-Guided 4D Gaussian Splatting
Tingxuan Huang, Haowei Zhu, Jun-Hai Yong, Hao Pan, Bin Wang
Abstract
Reconstructing dynamic 3D scenes with photorealistic detail and strong temporal coherence remains a significant challenge. Existing Gaussian splatting approaches for dynamic scene modeling often rely on per-frame optimization, which can overfit to instantaneous states instead of capturing underlying motion dynamics. To address this, we present Mango-GS, a multi-frame, node-guided framework for high-fidelity 4D reconstruction. Mango-GS leverages a temporal Transformer to model motion dependencies within a short window of frames, producing temporally consistent deformations. For efficiency, temporal modeling is confined to a sparse set of control nodes. Each node is represented by a decoupled canonical position and a latent code, providing a stable semantic anchor for motion propagation and preventing correspondence drift under large motion. Our framework is trained end-to-end, enhanced by an input masking strategy and two multi-frame losses to improve robustness. Extensive experiments demonstrate that Mango-GS achieves state-of-the-art reconstruction quality and real-time rendering speed, enabling high-fidelity reconstruction and interactive rendering of dynamic scenes. Code is available at https://github.com/htx0601/Mango-GS .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on33
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- Nerfies: Deformable Neural Radiance FieldsKeunhong Park, Utkarsh Sinha, Jonathan T. Barron, Sofien Bouaziz et al.ICCV 2021 · 1,442 citations
- Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian SplattingZeyu Yang, Hongye Yang, Zijie Pan, Li ZhangICLR 2024 · 529 citations
- 4D Gaussian Splatting for Real-Time Dynamic Scene RenderingGuanjun Wu, Taoran Yi, Jiemin Fang, Lingxi Xie et al.CVPR 2024 · 513 citations
Related papers
- MCGS: Markov Chain Gaussian Splatting for Dynamic Scenes ReconstructionYuzhong Wang, Wenmin Wang, Shixiong Zhang, Xinxing Yu et al.AAAI 2026 · 1 citation
- MoRGS: Efficient Per-Gaussian Motion Reasoning for Streamable Dynamic 3D ScenesWonjoon Lee, Sungmin Woo, Donghyeong Kim, Jungho Lee et al.CVPR 2026 · 2 citations
- Orientation-anchored Hyper-Gaussian for 4D Reconstruction from Casual VideosJunyi Wu, Jiachen Tao, Haoxuan Wang, Gaowen Liu et al.NeurIPS 2025 · 9 citations
- TagSplat: Topology-Aware Gaussian Splatting for Dynamic Mesh Modeling and TrackingHanzhi Guo, Dongdong Weng, Mo Su, Yixiao Chen et al.CVPR 2026 · 1 citation
- Motion Decoupled 3D Gaussian Splatting for Dynamic Object RepresentationXiao Hu, Libo Long, Jochen LangAAAI 2025 · 2 citations
