ReSplat: Degradation-agnostic Feed-forward Gaussian Splatting via Self-guided Residual Diffusion
Youngho Yoon, Kuk-Jin Yoon
摘要
Recent advances in novel view synthesis (NVS) have predominantly focused on ideal, clear input settings, limiting their applicability in real-world environments with common degradations such as blur, low-light, haze, rain, and snow. While some approaches address NVS under specific degradation types, they are often tailored to narrow cases, lacking the generalizability needed for broader scenarios. To address this issue, we propose Restoration-based feed-forward Gaussian Splatting, named ReSplat, a novel framework capable of handling degraded multi-view inputs. Our model jointly estimates restored images and gaussians to represent the clear scene for NVS. We enable multi-view consistent universal image restoration by utilizing the 3d gaussians generated during the diffusion sampling process as self-guidance. This results in sharper and more reliable novel views. Notably, our framework adapts to various degradations without prior knowledge of their specific types. Extensive experiments demonstrate that ReSplat significantly outperforms existing methods across challenging conditions, including blur, low-light, haze, rain, and snow, delivering superior visual quality and robust NVS performance. Code is available at https://github.com/yh-yoon/ReSplat.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper38
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 被引用 4,089 次
- PlenOctrees for Real-time Rendering of Neural Radiance FieldsAlex Yu, Ruilong Li, Matthew Tancik, Hao Li 等ICCV 2021 · 被引用 1,284 次
- Plenoxels: Radiance Fields without Neural NetworksSara Fridovich-Keil, Alex Yu, Matthew Tancik, Qinhong Chen 等CVPR 2022 · 被引用 1,237 次
相关 Paper
- RestorGS: Depth-aware Gaussian Splatting for Efficient 3D Scene RestorationYuanjian Qiao, Mingwen Shao, Lingzhuang Meng, Kai XuCVPR 2025
- HiSplat: Hierarchical 3D Gaussian Splatting for Generalizable Sparse-View ReconstructionShengji Tang, Weicai Ye, Peng Ye, Weihao Lin 等ICLR 2025
- HQGS: High-Quality Novel View Synthesis with Gaussian Splatting in Degraded ScenesXin Lin, Shi Luo, Xiaojun Shan, Xiaoyu Zhou 等ICLR 2025
- Dynamic Gaussian Splatting from Defocused and Motion-blurred Monocular VideosXuankai Zhang, Junjin Xiao, Qing ZhangNeurIPS 2025 · 被引用 2 次
- FlowR: Flowing from Sparse to Dense 3D ReconstructionsTobias Fischer, Samuel Rota Bulò, Yung-Hsu Yang, Nikhil Varma Keetha 等ICCV 2025 · 被引用 6 次
