FlightGPT: Towards Generalizable and Interpretable UAV Vision-and-Language Navigation with Vision-Language Models
Hengxing Cai, Jinhan Dong, Jingjun Tan, Jingcheng Deng, Sihang Li, Zhifeng Gao, Haidong Wang, Zicheng Su, Agachai Sumalee, Renxin Zhong
摘要
Unmanned Aerial Vehicle (UAV) Vision-and-Language Navigation (VLN) is vital for applications such as disaster response, logistics delivery, and urban inspection. However, existing methods often struggle with insufficient multimodal fusion, weak generalization, and poor interpretability. To address these challenges, we propose FlightGPT, a novel UAV VLN framework built upon Vision-Language Models (VLMs) with powerful multimodal perception capabilities. We design a two-stage training pipeline: first, Supervised Fine-Tuning (SFT) using high-quality demonstrations to improve initialization and structured reasoning; then, Group Relative Policy Optimization (GRPO) algorithm, guided by a composite reward that considers goal accuracy, reasoning quality, and format compliance, to enhance generalization and adaptability. Furthermore, FlightGPT introduces a Chain-of-Thought (CoT)-based reasoning mechanism to improve decision interpretability. Extensive experiments on the city-scale dataset CityNav demonstrate that FlightGPT achieves state-ofthe-art performance across all scenarios, with a 9.22% higher success rate than the strongest baseline in unseen environments. Our implementation is publicly available 1 .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- APEX: A Decoupled Memory-based Explorer for Asynchronous Aerial Object Goal NavigationDaoxuan Zhang, Ping Chen, Xiaobo Xia, Xiu Su 等CVPR 2026 · 被引用 10 次
- HTNav: A Hybrid Navigation Framework with Tiered Structure for Urban Aerial Vision-and-Language NavigationChengjie Fan, Cong Pan, Zijian Liu, Ningzhong Liu 等CVPR 2026 · 被引用 4 次
它引用的顶会 Paper1
相关 Paper
- FantasyVLN: Unified Multimodal Chain-of-Thought Reasoning for Vision-and-Language NavigationJing Zuo, Lingzhou Mu, Fan Jiang, Chengcheng Ma 等CVPR 2026 · 被引用 4 次
- AeroDuo: Aerial Duo for UAV-based Vision and Language NavigationRuipu Wu, Yige Zhang, Jinyu Chen, Linjiang Huang 等ACM MM 2025 · 被引用 6 次
- CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global MemoryWeichen Zhang, Chen Gao, Shiquan Yu, Ruiying Peng 等ACL 2025 · 被引用 22 次
- History-Enhanced Two-Stage Transformer for Aerial Vision-and-Language NavigationXichen Ding, Jianzhe Gao, Cong Pan, Wenguan Wang 等AAAI 2026 · 被引用 3 次
- NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language ModelsGengze Zhou, Yicong Hong, Qi WuAAAI 2024 · 被引用 361 次
