Robust agents learn causal world models
Jonathan Richens, Tom Everitt
2024年份
78被引次数
23顶会引用
摘要
It has long been hypothesised that causal reasoning plays a fundamental role in robust and general intelligence. However, it is not known if agents must learn causal models in order to generalise to new domains, or if other inductive biases are sufficient. We answer this question, showing that any agent capable of satisfying a regret bound under a large set of distributional shifts must have learned an approximate causal model of the data generating process, which converges to the true causal model for optimal agents. We discuss the implications of this result for several research areas including transfer learning and causal inference.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper23
- Honesty Is the Best Policy: Defining and Mitigating AI DeceptionFrancis Ward, Francesca Toni, Francesco Belardinelli, Tom EverittNeurIPS 2023 · 被引用 60 次
- SPARTAN: A Sparse Transformer World Model Attending to What MattersAnson Lei, Bernhard Schölkopf, Ingmar PosnerNeurIPS 2025 · 被引用 12 次
- Measuring Goal-DirectednessMatt MacDermott, James Fox, Francesco Belardinelli, Tom EverittNeurIPS 2024 · 被引用 9 次
- Agents Robust to Distribution Shifts Learn Causal World Models Even Under MediationMatteo Ceriscioli, Karthika MohanNeurIPS 2025 · 被引用 6 次
- A Principle of Targeted Intervention for Multi-Agent Reinforcement LearningAnjie Liu, Jianhong Wang, Samuel Kaski, Jun Wang 等NeurIPS 2025 · 被引用 3 次
它引用的顶会 Paper8
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah 等NeurIPS 2020 · 被引用 64,255 次
- Language Models Represent Space and TimeWes Gurnee, Max TegmarkICLR 2024 · 被引用 303 次
- A Calculus for Stochastic Interventions: Causal Effect Identification and Surrogate ExperimentsJuan D. Correa, Elias BareinboimAAAI 2020 · 被引用 90 次
- Agent Incentives: A Causal PerspectiveTom Everitt, Ryan Carey, Eric D. Langlois, Pedro A. Ortega 等AAAI 2021 · 被引用 66 次
- Honesty Is the Best Policy: Defining and Mitigating AI DeceptionFrancis Ward, Francesca Toni, Francesco Belardinelli, Tom EverittNeurIPS 2023 · 被引用 60 次
相关 Paper
- Theory-Based Causal Transfer: Integrating Instance-Level Induction and Abstract-Level Structure LearningMark Edmonds, Xiaojian Ma, Siyuan Qi, Yixin Zhu 等AAAI 2020 · 被引用 28 次
- Transportability for Bandits with Data from Different EnvironmentsAlexis Bellot, Alan Malek, Silvia ChiappaNeurIPS 2023 · 被引用 11 次
- General agents need world modelsJonathan Richens, Tom Everitt, David AbelICML 2025
- Generative Causal Representation Learning for Out-of-Distribution Motion ForecastingShayan Shirahmad Gale Bagi, Zahra Gharaee, Oliver Schulte, Mark CrowleyICML 2023 · 被引用 21 次
- Counterfactual Structural Causal BanditsMin Woo Park, Sanghack LeeICLR 2026 · 被引用 1 次
