Semantic Routing via Autoregressive Modeling
Eric Zhao, Pranjal Awasthi, Zhengdao Chen, Sreenivas Gollapudi, Daniel Delling
Abstract
We study learning-based approaches to semantic route planning, which concerns producing routes in response to rich queries that specify various criteria and preferences. Semantic routing is already widely found in industry applications, especially navigational services like Google Maps; however, existing implemenations only support limited route criteria and narrow query sets as they rely on repurposing classical route optimization algorithms. We argue for a learning-based approach to semantic routing as a more scalable and general alternative. To foster interest in this important application of graph learning, we are releasing a large-scale publicly-licensed benchmark for semantic routing consisting of real-world multi-objective navigation problems—expressed via natural language queries—on the richly annotated road networks of US cities. In addition to being intractable with existing approaches to semantic routing, our benchmark poses a significant scaling challenge for graph learning methods. As a proof-of-concept, we show that—at scale—even a standard transformer network is a powerful semantic routing sys-tem and achieves non-trivial performance on our benchmark. In the process, we demonstrate a simple solution to the challenge of scaling up graph learning: an autoregressive approach that decomposes semantic routing into smaller “next-edge” prediction problems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on11
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Toolformer: Language Models Can Teach Themselves to Use ToolsTimo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu et al.NeurIPS 2023 · 5,989 citations
- FlashAttention: Fast and Memory-Efficient Exact Attention with IO-AwarenessTri Dao, Daniel Y. Fu, Stefano Ermon, Atri Rudra et al.NeurIPS 2022 · 5,493 citations
- Tree of Thoughts: Deliberate Problem Solving with Large Language ModelsShunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran et al.NeurIPS 2023 · 5,068 citations
Related papers
- VL-RouterBench: A Benchmark for Vision–Language Model RoutingZhehao Huang, Baijiong Lin, Jingyuan Zhang, Jingying Wang et al.CVPR 2026 · 6 citations
- Beyond Simple Graphs: Neural Multi-Objective Routing on MultigraphsFilip Rydin, Attila Lischka, Jiaming Wu, Morteza Haghir Chehreghani et al.ICLR 2026 · 2 citations
- TurnBack: A Geospatial Route Cognition Benchmark for Large Language Models through Reverse RouteHongyi Luo, Qing Cheng, Daniel Matos, Hari Krishna Gadi et al.EMNLP 2025
- SMAP: Semantic Route Planning with Map-Grounded Multimodal AlignmentWenjie Zhang, Chen Yang, Xin Lu, Zhen Wang et al.CVPR 2026
- Generating Landmark Navigation Instructions from Maps as a Graph-to-Text ProblemRaphael Schumann, Stefan RiezlerACL 2021
