Joint-Space Empowerment as a Theory of Dexterous Motor Coordination
James Heald, Vittorio Caggiano, Vikash Kumar, Maneesh Sahani
摘要
Searching for effective policies is notoriously challenging in overactuated tendon-driven systems, where each joint is actuated by many muscles or motorized cables. Although this redundancy complicates naive policy search, it also implies that effective control can be captured by a low-dimensional action manifold. To identify such a manifold, we introduce Joint-Space Empowerment (JoSE), a novel information-theoretic objective that quantifies how much control an agent has over its mechanical degrees of freedom. We frame manifold discovery as an optimal precoding problem-where a state-dependent precoder maps low-dimensional latent actions to high-dimensional actions-and derive its closedform solution under learned control-affine Gaussian dynamics. Across both a musculoskeletal hand model and a tendon-driven robotic hand, we show that policies trained on this manifold achieve significantly enhanced dexterity, sample efficiency, and improved generalization. More broadly, these results present optimal precoding as a general information-theoretic paradigm for coordinating high-dimensional actuators to control low-dimensional features. Project page: https://joint-space-empowerment.github.io.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper13
- Dynamics-Aware Unsupervised Discovery of SkillsArchit Sharma, Shixiang Gu, Sergey Levine, Vikash Kumar 等ICLR 2020 · 被引用 475 次
- Reinforcement Learning in Feature Space: Matrix Bandit, Kernels, and Regret BoundLin Yang, Mengdi WangICML 2020 · 被引用 308 次
- FLAMBE: Structural Complexity and Representation Learning of Low Rank MDPsAlekh Agarwal, Sham M. Kakade, Akshay Krishnamurthy, Wen SunNeurIPS 2020 · 被引用 271 次
- Latent exploration for Reinforcement LearningAlberto Silvio Chiappa, Alessandro Marin Vargas, Ann Zixiang Huang, Alexander MathisNeurIPS 2023 · 被引用 41 次
- Information Prioritization through Empowerment in Visual Model-based RLHomanga Bharadhwaj, Mohammad Babaeizadeh, Dumitru Erhan, Sergey LevineICLR 2022 · 被引用 35 次
相关 Paper
- Explore to Learn: Latent Exploration Through Disentangled Synergy Patterns for Reinforcement Learning in Overactuated ControlYiming Wang, Kaiyan Zhao, Xu Li, Yan Li 等AAAI 2026 · 被引用 1 次
- DynSyn: Dynamical Synergistic Representation for Efficient Learning and Control in Overactuated Embodied SystemsKaibo He, Chenhui Zuo, Chengtian Ma, Yanan SuiICML 2024 · 被引用 19 次
- DEP-RL: Embodied Exploration for Reinforcement Learning in Overactuated and Musculoskeletal SystemsPierre Schumacher, Daniel F. B. Haeufle, Dieter Büchler, Syn Schmitt 等ICLR 2023 · 被引用 6 次
- Explore, Discover and Learn: Unsupervised Discovery of State-Covering SkillsVictor Campos, Alexander Trott, Caiming Xiong, Richard Socher 等ICML 2020 · 被引用 178 次
- Structural Action Transformer for 3D Dexterous ManipulationXiaohan Lei, Min Wang, Bohong Weng, Wengang Zhou 等CVPR 2026
