LangPrecip: Language-Aware Multimodal Precipitation Nowcasting
Ling Xudong, Lichaorong, Huang Tianxi, Qian Dong, Guiduo Duan
Abstract
Short-term precipitation nowcasting is inherently under-constrained due to limited historical observation windows: identical observations can lead to multiple plausible future trajectories, especially for extreme events. Existing generative methods rely solely on visual features and lack explicit constraints on precipitation motion semantics, resulting in ambiguous dynamics, blurred details, and unstable predictions. We propose LangPrecip, the first language-guided precipitation nowcasting framework, and contribute LangPrecip-160K, a large-scale radar-text paired dataset with 160K annotated sequences. LangPrecip addresses the under-constrained challenge by leveraging natural-language motion descriptions as explicit semantic constraints to reduce motion ambiguity and introducing a dual-path wavelet consistency unfolding decoder that enforces physical data fidelity during latent-to-pixel reconstruction. By reformulating nowcasting as semantically constrained trajectory generation under the Rectified Flow paradigm with model-based decoder optimization, LangPrecip produces sharper and more physically consistent forecasts. Experiments on Swedish and MRMS benchmarks demonstrate substantial improvements over state-of-the-art vision-only methods, achieving over 60% and 19% relative gains in heavy-rainfall CSI at 80minute lead time with enhanced spatial detail preservation. The dataset and code are available at github.com/UESTC-LXD/LangPrecip.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8f852cd2-3285-4b20-9ba0-9f0b2f4ea307Builds on13
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Frozen in Time: A Joint Video and Image Encoder for End-to-End RetrievalMax Bain, Arsha Nagrani, Gül Varol, Andrew ZissermanICCV 2021 · 1,550 citations
- ClimaX: A foundation model for weather and climateTung Nguyen, Johannes Brandstetter, Ashish Kapoor, Jayesh K. Gupta et al.ICML 2023 · 426 citations
- Make-A-Video: Text-to-Video Generation without Text-Video DataUriel Singer, Adam Polyak, Thomas Hayes, Xi Yin et al.ICLR 2023 · 313 citations
Related papers
- Perceptually Constrained Precipitation Nowcasting ModelWenzhi Feng, Xutao Li, Zhe Wu, Kenghong Lin et al.ICML 2025
- MoCast: Learning Turbulent Motions Under Physical Guidance for Precipitation NowcastingBinqing Wu, Weiqi Chen, Shiyu Liu, Zongjiang Shang et al.AAAI 2026
- Physically-Guided Data-Space Rectified Flow for Precipitation NowcastingWenjie Luo, chaorong li, Chuanhu Deng, Zhuo WangICML 2026
- CasCast: Skillful High-resolution Precipitation Nowcasting via Cascaded ModellingJunchao Gong, Lei Bai, Peng Ye, Wanghan Xu et al.ICML 2024 · 53 citations
- Extreme Weather Nowcasting via Local Precipitation Pattern PredictionChang hoon Song, Teng Yuan Chang, Youngjoon HongICLR 2026 · 5 citations
