When Replanning Becomes the Bottleneck: Budgeted Replanning for Embodied Agents
Shuaijun Liu, Feiyang You, Xingwei Chen, Ningxin Su
Abstract
Embodied agents replan frequently to recover from execution drift, partial observability, and coordination hazards, but each LLM-based replanning call can consume an accumulated textual context that grows over time and across agents. Once this context becomes large, replanning latency develops heavy tails and can miss real-time deadlines even when task success remains high, a failure mode that is hard to detect from average latency or success alone. We present BRACE, a controller that formulates replanning as a budgeted control loop by deciding whether to replan, selecting a replanning mode, and allocating an explicit token budget and latency service-level objective (SLO) while accounting for optional efficiency modules. As a reusable component, we introduce E-RECAP, a cost-aware progressive token pruning method that predicts token utility and prunes replanning contexts across transformer layers while preserving critical head and tail tokens. Across Meta Habitat, RoboFactory, and AirSim, BRACE with E-RECAP reduces replanning-call token counts by 62–92% and SLO violation rates from 85.5–100.0% to 4.7–50.0% in settings where task success is already saturated. In a harder RoboFactory setting where open-loop, frozen-plan, and No BRACE all fail, BRACE + E-RECAP reaches 80.0% success with 4.6% SLO violations, demonstrating that tail-aware per-call budgeting is effective across embodied platforms.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 186f641a-381e-4ecc-8942-3d4a6beac928Builds on17
- Habitat: A Platform for Embodied AI ResearchManolis Savva, Jitendra Malik, Devi Parikh, Dhruv Batra et al.ICCV 2019 · 1,863 citations
- Habitat 2.0: Training Home Assistants to Rearrange their HabitatAndrew Szot, Alexander Clegg, Eric Undersander, Erik Wijmans et al.NeurIPS 2021 · 826 citations
- 🏘️ ProcTHOR: Large-Scale Embodied AI Using Procedural GenerationMatt Deitke, Eli VanderBilt, Alvaro Herrasti, Luca Weihs et al.NeurIPS 2022 · 596 citations
- Self-Instruct: Aligning Language Models with Self-Generated InstructionsYizhong Wang, Yeganeh Kordi, Swaroop Mishra, Alisa Liu et al.ACL 2023 · 540 citations
- TEACh: Task-Driven Embodied Agents That ChatAishwarya Padmakumar, Jesse Thomason, Ayush Shrivastava, Patrick Lange et al.AAAI 2022 · 251 citations
Related papers
- ReCAP: Recursive Context-Aware Reasoning and Planning for Large Language Model AgentsZhenyu Zhang, Tianyi Chen, Weiran Xu, Alex Pentland et al.NeurIPS 2025 · 12 citations
- ReCAPA: Hierarchical Predictive Correction to Mitigate Cascading FailuresXiyin Zeng, Yuyu Sun, Haoyang Li, Shouqiang Liu et al.ICLR 2026 · 2 citations
- CaPo: Cooperative Plan Optimization for Efficient Embodied Multi-Agent CooperationJie Liu, Pan Zhou, Yingjun Du, Ah-Hwee Tan et al.ICLR 2025
- Mosaic: Runtime-Efficient Multi-Agent Embodied PlanningKunjal Panchal, Saayan Mitra, Sunav Choudhary, Victor Bursztyn et al.ICML 2026
- ReCA: Integrated Acceleration for Real-Time and Efficient Cooperative Embodied Autonomous AgentsZishen Wan, Yuhang Du, Mohamed Ibrahim, Jiayi Qian et al.ASPLOS 2025 · 7 citations
