Joint-Space Empowerment as a Theory of Dexterous Motor Coordination
James Heald, Vittorio Caggiano, Vikash Kumar, Maneesh Sahani
Abstract
Searching for effective policies is notoriously challenging in overactuated tendon-driven systems, where each joint is actuated by many muscles or motorized cables. Although this redundancy complicates naive policy search, it also implies that effective control can be captured by a low-dimensional action manifold. To identify such a manifold, we introduce Joint-Space Empowerment (JoSE), a novel information-theoretic objective that quantifies how much control an agent has over its mechanical degrees of freedom. We frame manifold discovery as an optimal precoding problem-where a state-dependent precoder maps low-dimensional latent actions to high-dimensional actions-and derive its closedform solution under learned control-affine Gaussian dynamics. Across both a musculoskeletal hand model and a tendon-driven robotic hand, we show that policies trained on this manifold achieve significantly enhanced dexterity, sample efficiency, and improved generalization. More broadly, these results present optimal precoding as a general information-theoretic paradigm for coordinating high-dimensional actuators to control low-dimensional features. Project page: https://joint-space-empowerment.github.io.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6622da2b-6924-47c6-9b84-16920dfd2dfeBuilds on13
- Dynamics-Aware Unsupervised Discovery of SkillsArchit Sharma, Shixiang Gu, Sergey Levine, Vikash Kumar et al.ICLR 2020 · 475 citations
- Reinforcement Learning in Feature Space: Matrix Bandit, Kernels, and Regret BoundLin Yang, Mengdi WangICML 2020 · 308 citations
- FLAMBE: Structural Complexity and Representation Learning of Low Rank MDPsAlekh Agarwal, Sham M. Kakade, Akshay Krishnamurthy, Wen SunNeurIPS 2020 · 271 citations
- Latent exploration for Reinforcement LearningAlberto Silvio Chiappa, Alessandro Marin Vargas, Ann Zixiang Huang, Alexander MathisNeurIPS 2023 · 41 citations
- Information Prioritization through Empowerment in Visual Model-based RLHomanga Bharadhwaj, Mohammad Babaeizadeh, Dumitru Erhan, Sergey LevineICLR 2022 · 35 citations
Related papers
- Explore to Learn: Latent Exploration Through Disentangled Synergy Patterns for Reinforcement Learning in Overactuated ControlYiming Wang, Kaiyan Zhao, Xu Li, Yan Li et al.AAAI 2026 · 1 citation
- DynSyn: Dynamical Synergistic Representation for Efficient Learning and Control in Overactuated Embodied SystemsKaibo He, Chenhui Zuo, Chengtian Ma, Yanan SuiICML 2024 · 19 citations
- DEP-RL: Embodied Exploration for Reinforcement Learning in Overactuated and Musculoskeletal SystemsPierre Schumacher, Daniel F. B. Haeufle, Dieter Büchler, Syn Schmitt et al.ICLR 2023 · 6 citations
- Explore, Discover and Learn: Unsupervised Discovery of State-Covering SkillsVictor Campos, Alexander Trott, Caiming Xiong, Richard Socher et al.ICML 2020 · 178 citations
- Structural Action Transformer for 3D Dexterous ManipulationXiaohan Lei, Min Wang, Bohong Weng, Wengang Zhou et al.CVPR 2026
