Frequency-Aware Uncertainty Gaussian Splatting for Dynamic Scene Reconstruction
Mingwen Shao, Yuanjian Qiao, Kai Zhang, Lingzhuang Meng
Abstract
3D Gaussian splatting has recently achieved remarkable progress in dynamic scene reconstruction. However, there remain two practical challenges: (1) Existing methods typically employ a strict point-wise deformation structure to model dynamic attributes, while neglecting the uncertain motion correlation in local space, leading to inferior adaptability to complex scenes. (2) The inherent low-frequency bias properties of Gaussians often lead to blurring artifacts due to the insufficient high-frequency learning of variable motions. To address these challenges, we propose a novel Frequency-aware Uncertainty Gaussian Splatting, termed FUGS, for adaptively reconstructing dynamic scenes in the Fourier space. Specifically, we design an Uncertainty-aware Deformation Model (UDM) that explicitly models motion attributes using learnable uncertainty relations with neighboring Gaussian points. Such a paradigm is capable of facilitating temporal and spatial motion correlation learning, thereby enabling flexible Gaussian deformations. Subsequently, a Dynamic Spectrum Regularization (DSR) is developed to perform coarse-to-fine Gaussian densification through low-to-high frequency filtering. By weighting the gradient with frequency distance, the Gaussian attribute is adaptively adjusted according to the scene complexity. Benefiting from the flexible optimization, our method achieves high-fidelity reconstruction of complex scenes while enjoying real-time rendering. Extensive experiments on synthetic and real-world datasets show that our FUGS exhibits significant superiority over state-of-the-art methods. The code will be available at https://github.com/KevinJoee/GS.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 75f07e6e-c5fa-45d0-b172-97eb741a9700Cited by top-tier papers2
- Illumination-Consistent Human-Scene Reconstruction from Monocular VideoRongbin Zheng, Wensheng Li, Lingzhe Zeng, Dong Wang et al.CVPR 2026
- CoRoGS: Contextual Gaussian Splatting for Robust Large-Deviation View SynthesisXin Ma, Peng Lu, Yisong Chen, Chengwei Pan et al.CVPR 2026
Related papers
- FreGS: 3D Gaussian Splatting with Progressive Frequency RegularizationJiahui Zhang, Fangneng Zhan, Muyu Xu, Shijian Lu et al.CVPR 2024 · 61 citations
- Frequency-aware Dynamic Gaussian SplattingQiaowei Miao, JinSheng Quan, Kehan Li, Yichao Xu et al.ICLR 2026
- 4D Gaussian Splatting in the Wild with Uncertainty-Aware RegularizationMijeong Kim, Jongwoo Lim, Bohyung HanNeurIPS 2024 · 33 citations
- Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene ReconstructionZiyi Yang, Xinyu Gao, Wen Zhou, Shaohui Jiao et al.CVPR 2024 · 302 citations
- ST-4DGS: Spatial-Temporally Consistent 4D Gaussian Splatting for Efficient Dynamic Scene RenderingDeqi Li, Shi-Sheng Huang, Zhiyuan Lu, Xinran Duan et al.SIGGRAPH 2024 · 33 citations
