WeatherSyn: An Instruction Tuning MLLM For Weather Forecasting Report Generation
Zinan Zheng, Yang Liu, Nuo Chen, Juepeng Zheng, Hong Cheng, Jia Li
Abstract
Accurate weather forecast reporting enables individuals and communities to better plan daily activities and agricultural operations. However, the current reporting process primarily relies on manual analysis of multi-source data, which leads to information overload and reduced efficiency. With the development of multimodal large language models (MLLMs), leveraging datadriven models to analyze and generate reports in the weather forecasting domain remains largely underexplored. In this work, we propose the Weather Forecasting Report (WFR) task and construct the first instruction-tuning dataset for this task, named WSInstruct, which covers 31 cities in America and 8 weather aspects. Based on this corpus, we develop the first model, Weath-erSyn, specialized in generating weather forecast reports. Evaluation across multiple metrics on our dataset shows that WeatherSyn consistently outperforms leading closed-source MLLMs, particularly on structurally complex weather aspects. We further analyze its performance across diverse geographic regions and weather aspects. Weath-erSyn demonstrates strong transferability across different regions, highlighting its zero-shot generalization capability. WeatherSyn offers valuable insight for developing MLLMs specialized in weather report generation. Codes are available at https://github.com/compasszzn/ WeatherSyn .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f6138f62-7c61-4779-abc9-6f41005d37aeBuilds on11
- SEVIR : A Storm Event Imagery Dataset for Deep Learning Applications in Radar and Satellite MeteorologyMark S. Veillette, Siddharth Samsi, Christopher J. MattioliNeurIPS 2020 · 179 citations
- PreDiff: Precipitation Nowcasting with Latent Diffusion ModelsZhihan Gao, Xingjian Shi, Boran Han, Hao Wang et al.NeurIPS 2023 · 171 citations
- VHM: Versatile and Honest Vision Language Model for Remote Sensing Image AnalysisChao Pang, Xingxing Weng, Jiang Wu, Jiayu Li et al.AAAI 2025 · 78 citations
- GraphWiz: An Instruction-Following Language Model for Graph Computational ProblemsNuo Chen, Yuhan Li, Jianheng Tang, Jia LiKDD 2024 · 14 citations
- Chain of Execution Supervision Promotes General Reasoning in Large Language ModelsNuo Chen, Zehua Li, Keqin Bao, Junyang Lin et al.NeurIPS 2025 · 6 citations
Related papers
- RadarQA: Multi-modal Quality Analysis of Weather Radar ForecastsXuming He, Zhiyuan You, Junchao Gong, Couhua Liu et al.NeurIPS 2025 · 14 citations
- Improving Attributed Long-form Question Answering with Intent AwarenessXinran Zhao, Aakanksha Naik, Jay DeYoung, Joseph Chee Chang et al.ICLR 2026 · 3 citations
- WeatherGFM: Learning a Weather Generalist Foundation Model via In-context LearningXiangyu Zhao, Zhiwang Zhou, Wenlong Zhang, Yihao Liu et al.ICLR 2025
- Scaling Text-Rich Image Understanding via Code-Guided Synthetic Multimodal Data GenerationYue Yang, Ajay Patel, Matt Deitke, Tanmay Gupta et al.ACL 2025
- Zephyrus: An Agentic Framework for Weather ScienceSumanth Varambally, Marshall Fisher, Jas Thakker, Yiwei Chen et al.ICLR 2026 · 9 citations
