GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priors
Xingyilang Yin, Qi Zhang, Jiahao Chang, Ying Feng, Qingnan Fan, Xi Yang, Chi-Man Pun, Huaqi Zhang, Xiaodong Cun
摘要
3D reconstruction and novel view synthesis (NVS) are fundamental tasks in computer vision and graphics, with wide-ranging real-world applications in virtual reality, autonomous driving, and robotics. Recently, 3D Gaussian Splatting (3DGS) (Kerbl et al., 2023) has achieved impressive results in both reconstruction quality and rendering efficiency when dense input views are available. However, its performance degrades significantly in sparse-view settings, where limited viewpoint information leads to under-constrained 3D representations. In such cases, 3DGS often suffers from severe artifacts, including distorted geometric structures and incomplete reconstructions, particularly in less-observed regions or extreme novel viewpoints. These limitations hinder its applicability in real-world scenarios where acquiring dense multi-view data is challenging. To alleviate the limitations, some previous regularization methods have been proposed to introduce additional constraints into the 3DGS optimization process, such as monocular depth (Li et al., 2024; Zhu et al., 2024) , frequency smoothness (Zhang et al., 2024) , and random dropout (Xu et al., 2025) . While these approaches can help prevent 3DGS representations from overfitting to sparse input views, they often remain sensitive to noise and yield only marginal improvements in NVS rendering quality. Inspired by the success of ReconFusion (Wu et al., 2024) , which introduces diffusion model into NeRF (Mildenhall et al., 2020) optimization, more recent studies (Liu et al., 2024b;a; Wu et al., 2025a;b) explore incorporating 3DGS optimization with powerful generative priors from diffusion models, which are trained on internet-scale data. These strong priors enable the correction of spurious geometry or the inpainting of plausible content in novel views. However, a key challenge still remains: maintaining visual and 3D consistency between the generated and original input images, especially when the novel views are far from the observed inputs. Meanwhile, recent advances in controllable video generation have demonstrated the effectiveness of incorporating various conditional signals (
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper8
- G4Splat: Geometry-Guided Gaussian Splatting with Generative PriorJunfeng Ni, Yixin Chen, Zhifei Yang, Yu Liu 等ICLR 2026 · 被引用 10 次
- GaussFusion: Improving 3D Reconstruction in the Wild with A Geometry-Informed Video GeneratorLiyuan Zhu, Manjunath Narayana, Michal Stary, Will Hutchcroft 等CVPR 2026 · 被引用 7 次
- Pantheon360: Taming Digital Twin Generation via 3D-Aware 360° Video DiffusionTing-Hsuan Chen, Ying-Huan Chen, Tao Tu, Jie-Ying Lee 等CVPR 2026 · 被引用 2 次
- HAD: Hallucination-Aware Diffusion Priors for 3D ReconstructionXi Liu, Weiwei Sun, Zhou Ren, Chris Broaddus 等CVPR 2026 · 被引用 1 次
- CrowdGaussian: Reconstructing High-Fidelity 3D Gaussians for Human Crowd from a Single ImageYizheng Song, Yiyu Zhuang, Qipeng Xu, Haixiang Wang 等CVPR 2026 · 被引用 1 次
它引用的顶会 Paper41
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationJunnan Li, Dongxu Li, Caiming Xiong, Steven C. H. HoiICML 2022 · 被引用 6,549 次
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 被引用 5,568 次
- Zero-1-to-3: Zero-shot One Image to 3D ObjectRuoshi Liu, Rundi Wu, Basile Van Hoorick, Pavel Tokmakov 等ICCV 2023 · 被引用 1,662 次
相关 Paper
- MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse ViewsYuedong Chen, Chuanxia Zheng, Haofei Xu, Bohan Zhuang 等NeurIPS 2024 · 被引用 126 次
- 3DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion PriorsXi Liu, Chaoyi Zhou, Siyu HuangNeurIPS 2024 · 被引用 127 次
- GeoQuery: Geometry-Query Diffusion for Sparse-View ReconstructionXiao Cao, Yuze Li, Youmin Zhang, Jiayu Song 等SIGGRAPH 2026
- FewViewGS: Gaussian Splatting with Few View Matching and Multi-stage TrainingRuihong Yin, Vladimir Yugay, Yue Li, Sezer Karaoglu 等NeurIPS 2024 · 被引用 29 次
- DcSplat: Dual-Constraint Human Gaussian Splatting with Latent Multi-View ConsistencyTengfei Xiao, Yue Wu, Zhigang Gao, Yongzhe Yuan 等AAAI 2026
