Hybrid Search for Efficient Planning with Completeness Guarantees
Kalle Kujanpää, Joni Pajarinen, Alexander Ilin
摘要
Solving complex planning problems has been a long-standing challenge in computer science. Learning-based subgoal search methods have shown promise in tackling these problems, but they often suffer from a lack of completeness guarantees, meaning that they may fail to find a solution even if one exists. In this paper, we propose an efficient approach to augment a subgoal search method to achieve completeness in discrete action spaces. Specifically, we augment the high-level search with low-level actions to execute a multi-level (hybrid) search, which we call complete subgoal search. This solution achieves the best of both worlds: the practical efficiency of high-level search and the completeness of low-level search. We apply the proposed search method to a recently proposed subgoal search algorithm and evaluate the algorithm trained on offline data on complex planning problems. We demonstrate that our complete subgoal search not only guarantees completeness but can even improve performance in terms of search expansions for instances that the high-level could solve without low-level augmentations. Our approach makes it possible to apply subgoal-level planning for systems where completeness is a critical requirement.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper3
- WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the EnvironmentHao Tang, Darren Key, Kevin EllisNeurIPS 2024 · 被引用 123 次
- OptionZero: Planning with Learned OptionsPo-Wei Huang, Pei-Chiun Peng, Hung Guei, Ti-Rong WuICLR 2025
- Structure-Induced Information for Rerooting Levin Tree SearchJake Tuero, Michael Buro, Laurent Orseau, Levi LelisICML 2026
它引用的顶会 Paper13
- Conservative Q-Learning for Offline Reinforcement LearningAviral Kumar, Aurick Zhou, George Tucker, Sergey LevineNeurIPS 2020 · 被引用 2,881 次
- PaLM-E: An Embodied Multimodal Language ModelDanny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch 等ICML 2023 · 被引用 2,601 次
- Decision Transformer: Reinforcement Learning via Sequence ModelingLili Chen, Kevin Lu, Aravind Rajeswaran, Kimin Lee 等NeurIPS 2021 · 被引用 2,557 次
- Hierarchical Foresight: Self-Supervised Learning of Long-Horizon Tasks via Visual Subgoal GenerationSuraj Nair, Chelsea FinnICLR 2020 · 被引用 152 次
- Long-Horizon Visual Planning with Goal-Conditioned Hierarchical PredictorsKarl Pertsch, Oleh Rybkin, Frederik Ebert, Shenghao Zhou 等NeurIPS 2020 · 被引用 96 次
相关 Paper
- Learning Rational Subgoals from Demonstrations and InstructionsZhezheng Luo, Jiayuan Mao, Jiajun Wu, Tomás Lozano-Pérez 等AAAI 2023 · 被引用 5 次
- Hierarchical Imitation Learning with Vector Quantized ModelsKalle Kujanpää, Joni Pajarinen, Alexander IlinICML 2023 · 被引用 17 次
- AlgoSolve: Supporting Subgoal Learning in Algorithmic Problem-Solving with Learnersourced MicrotasksKabdo Choi, Hyungyu Shin, Meng Xia, Juho KimCHI 2022 · 被引用 9 次
- Fast and Precise: Adjusting Planning Horizon with Adaptive Subgoal SearchMichal Zawalski, Michal Tyrolski, Konrad Czechowski, Tomasz Odrzygózdz 等ICLR 2023
- How to Solve Contextual Goal-Oriented Problems with Offline Datasets?Ying Fan, Jingling Li, Adith Swaminathan, Aditya Modi 等NeurIPS 2024 · 被引用 1 次
