LangPrecip: Language-Aware Multimodal Precipitation Nowcasting
Ling Xudong, Lichaorong, Huang Tianxi, Qian Dong, Guiduo Duan
摘要
Short-term precipitation nowcasting is inherently under-constrained due to limited historical observation windows: identical observations can lead to multiple plausible future trajectories, especially for extreme events. Existing generative methods rely solely on visual features and lack explicit constraints on precipitation motion semantics, resulting in ambiguous dynamics, blurred details, and unstable predictions. We propose LangPrecip, the first language-guided precipitation nowcasting framework, and contribute LangPrecip-160K, a large-scale radar-text paired dataset with 160K annotated sequences. LangPrecip addresses the under-constrained challenge by leveraging natural-language motion descriptions as explicit semantic constraints to reduce motion ambiguity and introducing a dual-path wavelet consistency unfolding decoder that enforces physical data fidelity during latent-to-pixel reconstruction. By reformulating nowcasting as semantically constrained trajectory generation under the Rectified Flow paradigm with model-based decoder optimization, LangPrecip produces sharper and more physically consistent forecasts. Experiments on Swedish and MRMS benchmarks demonstrate substantial improvements over state-of-the-art vision-only methods, achieving over 60% and 19% relative gains in heavy-rainfall CSI at 80minute lead time with enhanced spatial detail preservation. The dataset and code are available at github.com/UESTC-LXD/LangPrecip.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper13
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Frozen in Time: A Joint Video and Image Encoder for End-to-End RetrievalMax Bain, Arsha Nagrani, Gül Varol, Andrew ZissermanICCV 2021 · 被引用 1,550 次
- ClimaX: A foundation model for weather and climateTung Nguyen, Johannes Brandstetter, Ashish Kapoor, Jayesh K. Gupta 等ICML 2023 · 被引用 426 次
- Make-A-Video: Text-to-Video Generation without Text-Video DataUriel Singer, Adam Polyak, Thomas Hayes, Xi Yin 等ICLR 2023 · 被引用 313 次
相关 Paper
- Perceptually Constrained Precipitation Nowcasting ModelWenzhi Feng, Xutao Li, Zhe Wu, Kenghong Lin 等ICML 2025
- MoCast: Learning Turbulent Motions Under Physical Guidance for Precipitation NowcastingBinqing Wu, Weiqi Chen, Shiyu Liu, Zongjiang Shang 等AAAI 2026
- Physically-Guided Data-Space Rectified Flow for Precipitation NowcastingWenjie Luo, chaorong li, Chuanhu Deng, Zhuo WangICML 2026
- CasCast: Skillful High-resolution Precipitation Nowcasting via Cascaded ModellingJunchao Gong, Lei Bai, Peng Ye, Wanghan Xu 等ICML 2024 · 被引用 53 次
- Extreme Weather Nowcasting via Local Precipitation Pattern PredictionChang hoon Song, Teng Yuan Chang, Youngjoon HongICLR 2026 · 被引用 5 次
