Additive Causal Bandits with Unknown Graph
Alan Malek, Virginia Aglietti, Silvia Chiappa
摘要
We explore algorithms to select actions in the causal bandit setting where the learner can choose to intervene on a set of random variables related by a causal graph, and the learner sequentially chooses interventions and observes a sample from the interventional distribution. The learner's goal is to quickly find the intervention, among all interventions on observable variables, that maximizes the expectation of an outcome variable. We depart from previous literature by assuming no knowledge of the causal graph except that latent confounders between the outcome and its ancestors are not present. We first show that the unknown graph problem can be exponentially hard in the parents of the outcome. To remedy this, we adopt an additional additive assumption on the outcome which allows us to solve the problem by casting it as an additive combinatorial linear bandit problem with full-bandit feedback. We propose a novel action-elimination algorithm for this setting, show how to apply this algorithm to the causal bandit problem, provide sample complexity bounds, and empirically validate our findings on a suite of randomly generated causal models, effectively showing that one does not need to explicitly learn the parents of the outcome to identify the best intervention.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper4
- Linear Causal Bandits: Unknown Graph and Soft InterventionsZirui Yan, Ali TajerNeurIPS 2024 · 被引用 11 次
- Partial Structure Discovery is Sufficient for No-regret Learning in Causal BanditsMuhammad Qasim Elahi, Mahsa Ghasemi, Murat KocaogluNeurIPS 2024 · 被引用 11 次
- Structural Causal Bandits under Markov EquivalenceMin Woo Park, Andy Arditi, Elias Bareinboim, Sanghack LeeNeurIPS 2025 · 被引用 3 次
- Causal Bandits: The Pareto Optimal Frontier of Adaptivity, a Reduction to Linear Bandits, and Limitations around Unknown MarginalsZiyi Liu, Idan Attias, Daniel M. RoyICML 2024 · 被引用 2 次
它引用的顶会 Paper5
- Is a Good Representation Sufficient for Sample Efficient Reinforcement Learning?Simon S. Du, Sham M. Kakade, Ruosong Wang, Lin F. YangICLR 2020 · 被引用 213 次
- Causal Bandits with Unknown Graph StructureYangyi Lu, Amirhossein Meisami, Ambuj TewariNeurIPS 2021 · 被引用 53 次
- Adaptively Exploiting d-Separators with Causal BanditsBlair L. Bilodeau, Linbo Wang, Daniel M. RoyNeurIPS 2022 · 被引用 25 次
- Combinatorial Pure Exploration with Full-Bandit or Partial Linear FeedbackYihan Du, Yuko Kuroki, Wei ChenAAAI 2021 · 被引用 23 次
- Combinatorial Pure Exploration of Causal BanditsNuoya Xiong, Wei ChenICLR 2023
相关 Paper
- Approximate Allocation Matching for Structural Causal Bandits with Unobserved ConfoundersLai Wei, Muhammad Qasim Elahi, Mahsa Ghasemi, Murat KocaogluNeurIPS 2023 · 被引用 10 次
- Learning Mixtures of Unknown Causal InterventionsAbhinav Kumar, Kirankumar Shiragur, Caroline UhlerNeurIPS 2024 · 被引用 1 次
- Actively Identifying Causal Effects with Latent Variables Given Only Response Variable ObservableTian-Zuo Wang, Zhi-Hua ZhouNeurIPS 2021 · 被引用 7 次
- Constrained Causal Bayesian OptimizationVirginia Aglietti, Alan Malek, Ira Ktena, Silvia ChiappaICML 2023 · 被引用 9 次
- Combinatorial Causal BanditsShi Feng, Wei ChenAAAI 2023 · 被引用 16 次
