Plasticity as the Mirror of Empowerment
David Abel, Michael Bowling, André Barreto, Will Dabney, Shi Dong, Steven Hansen, Anna Harutyunyan, Khimya Khetarpal, Clare Lyle, Razvan Pascanu, Georgios Piliouras, Doina Precup
摘要
Agents are minimally entities that are influenced by their past observations and act to influence future observations. This latter capacity is captured by empowerment, which has served as a vital framing concept across artificial intelligence and cognitive science. This former capacity, however, is equally foundational: In what ways, and to what extent, can an agent be influenced by what it observes? In this paper, we ground this concept in a universal agent-centric measure that we refer to as plasticity, and reveal a fundamental connection to empowerment. Following a set of desiderata on a suitable definition, we define plasticity using a new information-theoretic quantity we call the generalized directed information. We show that this new quantity strictly generalizes the directed information introduced by Massey (1990) while preserving all of its desirable properties. Under this definition, we find that plasticity is well thought of as the mirror of empowerment: The two concepts are defined using the same measure, with only the direction of influence reversed. Our main result establishes a tension between the plasticity and empowerment of an agent, suggesting that agent design needs to be mindful of both characteristics. We explore the implications of these findings, and suggest that plasticity, empowerment, and their relationship are essential to understanding agency
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Training LLM Agents to Empower HumansEvan Ellis, Vivek Myers, Jens Tuyls, Sergey Levine 等ICML 2026 · 被引用 4 次
- Compositional Behavioral Semantics for State Abstraction in Reinforcement LearningYivan Zhang, Ziyan Luo, Manuel BaltieriICML 2026
它引用的顶会 Paper8
- Explore, Discover and Learn: Unsupervised Discovery of State-Covering SkillsVictor Campos, Alexander Trott, Caiming Xiong, Richard Socher 等ICML 2020 · 被引用 178 次
- A Definition of Continual Reinforcement LearningDavid Abel, André Barreto, Benjamin Van Roy, Doina Precup 等NeurIPS 2023 · 被引用 167 次
- Understanding Plasticity in Neural NetworksClare Lyle, Zeyu Zheng, Evgenii Nikishin, Bernardo Ávila Pires 等ICML 2023 · 被引用 162 次
- Optimal Policies Tend To Seek PowerAlexander Matt Turner, Logan Smith, Rohin Shah, Andrew Critch 等NeurIPS 2021 · 被引用 111 次
- Settling the Reward HypothesisMichael Bowling, John D. Martin, David Abel, Will DabneyICML 2023 · 被引用 47 次
相关 Paper
- Estimating the Empowerment of Language Model AgentsJinyeop Song, Jeff Gore, Max Kleiman-WeinerICML 2026
- Learning to Assist Humans without Inferring RewardsVivek Myers, Evan Ellis, Sergey Levine, Benjamin Eysenbach 等NeurIPS 2024 · 被引用 16 次
- Learning to Perceive the World Through Control: Empowerment-Based Representation LearningMahsa Bastankhah, Sophie Broderick, Benjamin EysenbachICML 2026
- AvE: Assistance via EmpowermentYuqing Du, Stas Tiomkin, Emre Kiciman, Daniel Polani 等NeurIPS 2020 · 被引用 51 次
- Measuring Goal-DirectednessMatt MacDermott, James Fox, Francesco Belardinelli, Tom EverittNeurIPS 2024 · 被引用 9 次
