Let it Snow! Animating 3D Gaussian Scenes with Dynamic Weather Effects via Physics-Guided Score Distillation
Gal Fiebelman, Hadar Averbuch-Elor, Sagie Benaim
摘要
3D Gaussian Splatting has recently enabled fast and photorealistic reconstruction of static 3D scenes. However, dynamic editing of such scenes remains a significant challenge. We introduce a novel framework, Physics-Guided Score Distillation, to address a fundamental conflict: physics simulation provides a strong motion prior that is insufficient for photorealism , while video-based Score Distillation Sampling (SDS) alone cannot generate coherent motion for complex, multi-particle scenarios. We resolve this through a unified optimization framework where physics simulation guides Score Distillation to jointly refine the motion prior for photorealism while simultaneously optimizing appearance. Specifically, we learn a neural dynamics model that predicts particle motion and appearance, optimized end-to-end via a combined loss integrating Video-SDS for photorealism with our physics-guidance prior. This allows for photorealistic refinements while ensuring the dynamics remain plausible. Our framework enables scene-wide dynamic weather effects, including snowfall, rainfall, fog, and sandstorms, with physically plausible motion. Experiments demonstrate our physics-guided approach significantly outperforms baselines, with ablations confirming this joint refinement is essential for generating coherent, high-fidelity dynamics.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Controllable Weather Synthesis and Removal with Video Diffusion ModelsChih-Hao Lin, Zian Wang, Ruofan Liang, Yuxuan Zhang 等ICCV 2025 · 被引用 8 次
- WeatherCity: Urban Scene Reconstruction with Controllable Multi-Weather TransformationWenhua Wu, Huai Guan, Zhe Liu, Hesheng WangCVPR 2026 · 被引用 3 次
它引用的顶会 Paper28
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan 等CVPR 2022 · 被引用 1,603 次
- 2D Gaussian Splatting for Geometrically Accurate Radiance FieldsBinbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger 等SIGGRAPH 2024 · 被引用 660 次
- Instruct-NeRF2NeRF: Editing 3D Scenes with InstructionsAyaan Haque, Matthew Tancik, Alexei A. Efros, Aleksander Holynski 等ICCV 2023 · 被引用 544 次
相关 Paper
- PhysGM: Large Physical Gaussian Model for Feed-Forward 4D SynthesisChunji Lv, Zequn Chen, Donglin Di, Weinan Zhang 等CVPR 2026 · 被引用 9 次
- Gaussian Splashing: Unified Particles for Versatile Motion Synthesis and RenderingYutao Feng, Xiang Feng, Yintong Shang, Ying Jiang 等CVPR 2025
- GauSmoke: Hybrid Physics-Optical Gaussian Splatting for Sparse Smoke ReconstructionWenran Zhang, Yuxiang Cai, Letian Huang, Dongwei Ye 等SIGGRAPH 2026
- Unleashing the Potential of Multi-modal Foundation Models and Video Diffusion for 4D Dynamic Physical Scene SimulationZhuoman Liu, Weicai Ye, Yan Luximon, Pengfei Wan 等CVPR 2025
- SegmentDreamer: Towards High-Fidelity Text-to-3D Synthesis with Segmented Consistency Trajectory DistillationJiahao Zhu, Zixuan Chen, Guangcong Wang, Xiaohua Xie 等ICCV 2025
