TrajEvo: Trajectory Prediction Heuristics Design via LLM-driven Evolution
Zhikai Zhao, Chuanbo Hua, Federico Berto, Kanghoon Lee, Zihan Ma, Jiachen Li, Jinkyoo Park
Abstract
Trajectory prediction is a critical task in modeling human behavior, especially in safety-critical domains such as social robotics and autonomous vehicle navigation. Traditional heuristics based on handcrafted rules often lack accuracy and generalizability. Although deep learning approaches offer improved performance, they typically suffer from high computational cost, limited explainability, and, importantly, poor generalization to out-of-distribution (OOD) scenarios. In this paper, we introduce TRAJEVO, a framework that leverages Large Language Models (LLMs) to automatically design trajectory prediction heuristics. TRAJEVO employs an evolutionary algorithm to generate and refine prediction heuristics from past trajectory data. We propose two key innovations: Cross-Generation Elite Sampling to encourage population diversity, and a Statistics Feedback Loop that enables the LLM to analyze and improve alternative predictions. Our evaluations demonstrate that TRAJEVO outperforms existing heuristic methods across multiple real-world datasets, and notably surpasses both heuristic and deep learning methods in generalizing to an unseen OOD real-world dataset. TRAJEVO marks a promising step toward the automated design of fast, explainable, and generalizable trajectory prediction heuristics. We release our source code to facilitate future research at https://github.com/ai4co/trajevo .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Drive My Way: Preference Alignment of Vision-Language-Action Model for Personalized DrivingZehao Wang, Huaide Jiang, Shuaiwu Dong, Yuping Wang et al.CVPR 2026 · 7 citations
- Uniocc: a Unified Benchmark for Occupancy Forecasting and Prediction in Autonomous DrivingYuping Wang, Xiangyu Huang, Xiaokang Sun, Mingxuan Yan et al.ICCV 2025 · 3 citations
Builds on17
- STGAT: Modeling Spatial-Temporal Interactions for Human Trajectory PredictionYingfan Huang, Huikun Bi, Zhaoxin Li, Tianlu Mao et al.ICCV 2019 · 615 citations
- ReEvo: Large Language Models as Hyper-Heuristics with Reflective EvolutionHaoran Ye, Jiarui Wang, Zhiguang Cao, Federico Berto et al.NeurIPS 2024 · 424 citations
- Stochastic Trajectory Prediction via Motion Indeterminacy DiffusionTianpei Gu, Guangyi Chen, Junlong Li, Chunze Lin et al.CVPR 2022 · 261 citations
- EvolveGraph: Multi-Agent Trajectory Prediction with Dynamic Relational ReasoningJiachen Li, Fan Yang, Masayoshi Tomizuka, Chiho ChoiNeurIPS 2020 · 258 citations
- Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language ModelFei Liu, Xialiang Tong, Mingxuan Yuan, Xi Lin et al.ICML 2024 · 238 citations
Related papers
- TrajAgent: An LLM-Agent Framework for Trajectory Modeling via Large-and-Small Model CollaborationYuwei Du, Jie Feng, Jie Zhao, Yong LiNeurIPS 2025 · 8 citations
- Trajectory-LLM: A Language-based Data Generator for Trajectory Prediction in Autonomous DrivingKairui Yang, Zihao Guo, Gengjie Lin, Haotian Dong et al.ICLR 2025
- AutoTraces: Autoregressive Trajectory Forecasting via Multimodal Large Language ModelsTeng Wang, Yanting Lu, Ruize WangCVPR 2026
- REvolve: Reward Evolution with Large Language Models using Human FeedbackRishi Hazra, Alkis Sygkounas, Andreas Persson, Amy Loutfi et al.ICLR 2025
- Traj-MLLM: Can Multimodal Large Language Models Reform Trajectory Data Mining?Shuo Liu, Di Yao, Yan Lin, Gao Cong et al.KDD 2026 · 2 citations
