GeoDiT: A Diffusion-based Vision-Language Model for Geospatial Understanding
Jiaqi Liu, Ronghao Fu, Haoran Liu, Lang Sun, Qipeng Wang, Bo Yang
Abstract
Autoregressive models are structurally misaligned with the inherently parallel nature of geospatial understanding, forcing a rigid sequential narrative onto scenes and fundamentally hindering the generation of structured and coherent outputs. We challenge this paradigm by reframing geospatial generation as a parallel refinement process, enabling a holistic, coarse-to-fine synthesis that resolves all semantic elements simultaneously. To operationalize this, we introduce GeoDiT, the first diffusionbased vision-language model tailored for the geospatial domain. Extensive experiments demonstrate that GeoDiT establishes a new state-of-the-art on benchmarks requiring structured, object-centric outputs. It achieves significant gains in image captioning, visual grounding, and multi-object detection, precisely the tasks where autoregressive models falter. Our work validates that aligning the generative process with the data's intrinsic structure is key to unlocking superior performance in complex geospatial analysis. Resources can be found in https://github.com/ViTBerger/GeoDiT.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8db84d52-2335-49b7-b8ea-00780c77f049Cited by top-tier papers1
Ask how each one uses itBuilds on9
- Large Language Diffusion ModelsShen Nie, Fengqi Zhu, Zebin You, Xiaolu Zhang et al.NeurIPS 2025 · 949 citations
- SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote SensingZhecheng Wang, Rajanie Prabha, Tianyuan Huang, Jiajun Wu et al.AAAI 2024 · 167 citations
- LLaDA-V: Large Language Diffusion Models with Visual Instruction TuningZebin You, Shen Nie, Xiaolu Zhang, JUN ZHOU et al.CVPR 2026 · 154 citations
- LaViDa: A Large Diffusion Language Model for Multimodal UnderstandingShufan Li, Konstantinos Kallidromitis, Hritik Bansal, Akash Gokul et al.NeurIPS 2025 · 89 citations
- VHM: Versatile and Honest Vision Language Model for Remote Sensing Image AnalysisChao Pang, Xingxing Weng, Jiang Wu, Jiayu Li et al.AAAI 2025 · 78 citations
Related papers
- Dual Diffusion for Unified Image Generation and UnderstandingZijie Li, Henry Li, Yichun Shi, Amir Barati Farimani et al.CVPR 2025
- When Diffusion Language Models Hesitate: Detecting and Correcting Visual Hallucinations via Confidence FluctuationWenzheng Song, Pei Chen, Yichen Tan, Zejian Li et al.ICML 2026
- Escaping the Likelihood Trap: Geometric Diversity Optimization for Long-Form Image CaptioningQingmei Tang, Shuai Hao, Rong Fu, Zirui Mo et al.ICML 2026
- Denoising Token Prediction in Masked Autoregressive ModelsTing Yao, Yehao Li, Yingwei Pan, Zhaofan Qiu et al.ICCV 2025 · 2 citations
- Seg4Diff: Unveiling Open-Vocabulary Semantic Segmentation in Text-to-Image Diffusion TransformersChaehyun Kim, Heeseong Shin, Eunbeen Hong, Heeji Yoon et al.NeurIPS 2025 · 6 citations
