Cerebellar-Inspired Residual Control for Fault Recovery: From Inference-Time Adaptation to Structural Consolidation
Nethmi Jayasinghe, Diana Gontero, Spencer Brown, Vinod Sangwan, Mark Hersam, Amit Trivedi
Abstract
Robotic policies deployed in real-world environments often encounter post-training faults, where retraining, exploration, or system identification are impractical. We introduce an inference-time, cerebellar-inspired residual control framework that augments a frozen reinforcement learning policy with online corrective actions, enabling fault recovery without modifying base policy parameters. The framework instantiates core cerebellar principles, including high-dimensional pattern separation via fixed feature expansion, parallel microzone-style residual pathways, and local error-driven plasticity with excitatory and inhibitory eligibility traces operating at distinct time scales. These mechanisms enable fast, localized correction under post-training disturbances while avoiding destabilizing global policy updates. A conservative, performance-driven meta-adaptation regulates residual gain and plasticity, preserving nominal behavior and suppressing unnecessary intervention. Experiments on MuJoCo benchmarks under actuator, dynamic, and environmental perturbations show improvements of up to % on and % on under moderate faults, with graceful degradation under severe shifts and complementary robustness from consolidating persistent residual corrections into policy parameters.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e6e07ad7-6e34-43b3-a438-911ca8475ebcBuilds on2
- Tent: Fully Test-Time Adaptation by Entropy MinimizationDequan Wang, Evan Shelhamer, Shaoteng Liu, Bruno A. Olshausen et al.ICLR 2021 · 1,731 citations
- Test-Time Training with Self-Supervision for Generalization under Distribution ShiftsYu Sun, Xiaolong Wang, Zhuang Liu, John Miller et al.ICML 2020 · 1,220 citations
Related papers
- MaskAdapt: Learning Flexible Motion Adaptation via Mask-Invariant Prior for Physics-Based CharactersSoomin Park, Eunseong Lee, Kwang Bin Lee, Sung-Hee LeeCVPR 2026
- What Makes Value Learning Efficient in Residual Reinforcement Learning?Guozheng Ma, Lu Li, Haoyu Wang, Zixuan Liu et al.ICML 2026 · 2 citations
- Neuroplastic Expansion in Deep Reinforcement LearningJiashun Liu, Johan S. Obando-Ceron, Aaron C. Courville, Ling PanICLR 2025
- World Models as Reference Trajectories for Rapid Motor AdaptationCarlos Stein Brito, Daniel McNameeNeurIPS 2025 · 2 citations
- MetaCURE: Meta Reinforcement Learning with Empowerment-Driven ExplorationJin Zhang, Jianhao Wang, Hao Hu, Tong Chen et al.ICML 2021 · 33 citations
