Predicate Invention for Bilevel Planning
Tom Silver, Rohan Chitnis, Nishanth Kumar, Willie McClinton, Tomás Lozano-Pérez, Leslie Pack Kaelbling, Joshua B. Tenenbaum
Abstract
Efficient planning in continuous state and action spaces is fundamentally hard, even when the transition model is deterministic and known. One way to alleviate this challenge is to perform bilevel planning with abstractions, where a high-level search for abstract plans is used to guide planning in the original transition space. Previous work has shown that when state abstractions in the form of symbolic predicates are hand-designed, operators and samplers for bilevel planning can be learned from demonstrations. In this work, we propose an algorithm for learning predicates from demonstrations, eliminating the need for manually specified state abstractions. Our key idea is to learn predicates by optimizing a surrogate objective that is tractable but faithful to our real efficient-planning objective. We use this surrogate objective in a hill-climbing search over predicate sets drawn from a grammar. Experimentally, we show across four robotic planning environments that our learned abstractions are able to quickly solve held-out tasks, outperforming six baselines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2afe1335-5572-4bf6-8423-a83cb40b41edCited by top-tier papers14
- Generalized Planning in PDDL Domains with Pretrained Large Language ModelsTom Silver, Soham Dan, Kavitha Srinivas, Joshua B. Tenenbaum et al.AAAI 2024 · 194 citations
- Leveraging Environment Interaction for Automated PDDL Translation and Planning with Large Language ModelsSadegh Mahdavi, Raquel Aoki, Keyi Tang, Yanshuai CaoNeurIPS 2024 · 28 citations
- ExoPredicator: Learning Abstract Models of Dynamic Worlds for Robot PlanningYichao Liang, Dat Nguyen, Cambridge Yang, Tianyang Li et al.ICLR 2026 · 11 citations
- One Demo Is All It Takes: Planning Domain Derivation with LLMs from A Single DemonstrationJinbang Huang, Yixin Xiao, Zhanguang Zhang, Mark Coates et al.ICLR 2026 · 9 citations
- Meta-learning Parameterized SkillsHaotian Fu, Shangqun Yu, Saket Tiwari, Michael Littman et al.ICML 2023 · 8 citations
Builds on4
- Online Bayesian Goal Inference for Boundedly Rational Planning AgentsTan Zhi-Xuan, Jordyn L. Mann, Tom Silver, Josh Tenenbaum et al.NeurIPS 2020 · 122 citations
- Learning Invariant Representations for Reinforcement Learning without ReconstructionAmy Zhang, Rowan Thomas McAllister, Roberto Calandra, Yarin Gal et al.ICLR 2021 · 77 citations
- GLIB: Efficient Exploration for Relational Model-Based Reinforcement Learning via Goal-Literal BabblingRohan Chitnis, Tom Silver, Joshua B. Tenenbaum, Leslie Pack Kaelbling et al.AAAI 2021 · 38 citations
- Discovering State and Action Abstractions for Generalized Task and Motion PlanningAidan Curtis, Tom Silver, Joshua B. Tenenbaum, Tomás Lozano-Pérez et al.AAAI 2022 · 36 citations
Related papers
- VisualPredicator: Learning Abstract World Models with Neuro-Symbolic Predicates for Robot PlanningYichao Liang, Nishanth Kumar, Hao Tang, Adrian Weller et al.ICLR 2025
- Learning with Language-Guided State AbstractionsAndi Peng, Ilia Sucholutsky, Belinda Z. Li, Theodore R. Sumers et al.ICLR 2024 · 20 citations
- Learning Planning Abstractions from LanguageWeiyu Liu, Geng Chen, Joy Hsu, Jiayuan Mao et al.ICLR 2024 · 6 citations
- Learning Generalized Relational Heuristic Networks for Model-Agnostic PlanningRushang Karia, Siddharth SrivastavaAAAI 2021 · 49 citations
- Learning Rational Subgoals from Demonstrations and InstructionsZhezheng Luo, Jiayuan Mao, Jiajun Wu, Tomás Lozano-Pérez et al.AAAI 2023 · 5 citations
