CompassNav: Steering From Path Imitation to Decision Understanding In Navigation
Linfeng Li, Jian Zhao, Yuan Xie, Xin Tan, Xuelong Li
Abstract
The dominant paradigm for training Large Vision-Language Models (LVLMs) in navigation relies on imitating expert trajectories. This approach reduces the complex navigation task to a sequence-to-sequence replication of a single correct path, fundamentally limiting the agent's ability to explore and generalize. In this work, we argue for and introduce a new paradigm: a shift from Path Imitation to Decision Understanding. The goal of this paradigm is to build agents that do not just follow, but truly understand how to navigate. We materialize this through two core contributions: first, we introduce Compass-Data-22k, a novel 22k-trajectory dataset.Its Reinforcement Fine-Tuning (RFT) subset provides a panoramic view of the decision landscape by annotating all feasible actions with A* geodesic distances. Second, we design a novel gap-aware hybrid reward function that dynamically adapts its feedback to decision certainty, shifting between decisive signals for optimal actions and nuanced scores to encourage exploration. Integrated into an SFT-then-RFT recipe, our CompassNav agent is trained not to memorize static routes, but to develop an internal "compass" that constantly intuits the direction to the goal by evaluating the relative quality of all possible moves. This approach enables our 7B agent to set a new state-of-the-art on Goal navigation benchmarks, outperforming even larger proprietary models, and achieve robust real-world goal navigation on a physical robot. Project page: https://linengcs.github.io/CompassNav
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f2e7690b-d0d6-44fd-9382-4b10ec44769bCited by top-tier papers5
- MSGNav: Unleashing the Power of Multi-modal 3D Scene Graph for Zero-Shot Embodied NavigationXun Huang, Shijia Zhao, Yunxiang Wang, Xin Lu et al.CVPR 2026 · 19 citations
- Explore with Long-term Memory: A Benchmark and Multimodal LLM-based Reinforcement Learning Framework for Embodied ExplorationSen Wang, Bangwei Liu, Zhenkun Gao, Lizhuang Ma et al.CVPR 2026 · 14 citations
- NaviMaster: Learning a Unified Policy for GUI and Embodied Navigation TasksZhihao Luo, Wentao Yan, Jingyu Gong, Min Wang et al.ACL 2026 · 13 citations
- Hydra-Nav: Object Navigation via Adaptive Dual-Process ReasoningZixuan Wang, Huang Fang, Shaoan Wang, Yuanfei Luo et al.ICML 2026 · 4 citations
- TPRU: Advancing Temporal and Procedural Understanding in Large Multimodal ModelsZhenkun Gao, Xuhong Wang, Xin Tan, Yuan XieICLR 2026 · 1 citation
Builds on10
- Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning et al.NeurIPS 2023 · 10,924 citations
- Object Goal Navigation using Goal-Oriented Semantic ExplorationDevendra Singh Chaplot, Dhiraj Gandhi, Abhinav Gupta, Ruslan SalakhutdinovNeurIPS 2020 · 857 citations
- 🏘️ ProcTHOR: Large-Scale Embodied AI Using Procedural GenerationMatt Deitke, Eli VanderBilt, Alvaro Herrasti, Luca Weihs et al.NeurIPS 2022 · 596 citations
- Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal GroundingAlexander Ku, Peter Anderson, Roma Patel, Eugene Ie et al.EMNLP 2020 · 208 citations
- BeliefMapNav: 3D Voxel-Based Belief Map for Zero-Shot Object NavigationZibo Zhou, Yue Hu, Lingkai Zhang, Zonglin Li et al.NeurIPS 2025 · 31 citations
Related papers
- Instruction Decomposition and Action Alignment for Vision-Language NavigationZihao Xin, Wentong Li, Yixuan Jiang, Bin Wang et al.ICML 2026
- AwareVLN: Reasoning with Self-awareness for Vision-Language NavigationWenxuan Guo, Xiuwei Xu, Yichen Liu, Xiangyu Li et al.CVPR 2026 · 7 citations
- Curriculum Learning for Vision-and-Language NavigationJiwen Zhang, Zhongyu Wei, Jianqing Fan, Jiajie PengNeurIPS 2021 · 33 citations
- Contrastive Instruction-Trajectory Learning for Vision-Language NavigationXiwen Liang, Fengda Zhu, Yi Zhu, Bingqian Lin et al.AAAI 2022 · 29 citations
- General Scene Adaptation for Vision-and-Language NavigationHaodong Hong, Yanyuan Qiao, Sen Wang, Jiajun Liu et al.ICLR 2025
