Zero-shot causal learning
Hamed Nilforoshan, Michael Moor, Yusuf H. Roohani, Yining Chen, Anja Surina, Michihiro Yasunaga, Sara Oblak, Jure Leskovec
Abstract
Predicting how different interventions will causally affect a specific individual is important in a variety of domains such as personalized medicine, public policy, and online marketing. There are a large number of methods to predict the effect of an existing intervention based on historical data from individuals who received it. However, in many settings it is important to predict the effects of novel interventions (e.g., a newly invented drug), which these methods do not address. Here, we consider zero-shot causal learning: predicting the personalized effects of a novel intervention. We propose CaML, a causal meta-learning framework which formulates the personalized prediction of each intervention's effect as a task. CaML trains a single meta-model across thousands of tasks, each constructed by sampling an intervention, its recipients, and its nonrecipients. By leveraging both intervention information (e.g., a drug's attributes) and individual features (e.g., a patient's history), CaML is able to predict the personalized effects of novel interventions that do not exist at the time of training. Experimental results on real world datasets in large-scale medical claims and cell-line perturbations demonstrate the effectiveness of our approach. Most strikingly, 's zero-shot predictions outperform even strong baselines trained directly on data from the test interventions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cf6e7598-479c-49bb-abfd-afcd4ba743c3Cited by top-tier papers7
- Do-PFN: In-Context Learning for Causal Effect EstimationJake Robertson, Arik Reuter, Siyuan Guo, Noah Hollmann et al.NeurIPS 2025 · 58 citations
- CausalPFN: Amortized Causal Effect Estimation via In-Context LearningVahid Balazadeh Meresht, Hamidreza Kamkari, Valentin Thomas, Junwei Ma et al.NeurIPS 2025 · 52 citations
- Foundation Models for Causal Inference via Prior-Data Fitted NetworksYuchen Ma, Dennis Frauen, Emil Javurek, Stefan FeuerriegelICLR 2026 · 37 citations
- Towards Causal Foundation Model: on Duality between Optimal Balancing and AttentionJiaqi Zhang, Joel Jennings, Agrin Hilmkil, Nick Pawlowski et al.ICML 2024 · 9 citations
- Doubly Robust Fusion of Many Treatments for Policy LearningKe Zhu, Jianing Chu, Ilya Lipkovich, Wenyu Ye et al.ICML 2025
Builds on7
- WILDS: A Benchmark of in-the-Wild Distribution ShiftsPang Wei Koh, Shiori Sagawa, Henrik Marklund, Sang Michael Xie et al.ICML 2021 · 1,773 citations
- Learning Disentangled Representations for CounterFactual RegressionNegar Hassanpour, Russell GreinerICLR 2020 · 176 citations
- On Inductive Biases for Heterogeneous Treatment Effect EstimationAlicia Curth, Mihaela van der SchaarNeurIPS 2021 · 114 citations
- Causal Effect Inference for Structured TreatmentsJean Kaddour, Yuchen Zhu, Qi Liu, Matt J. Kusner et al.NeurIPS 2021 · 62 citations
- Causal Conceptions of Fairness and their ConsequencesHamed Nilforoshan, Johann D. Gaebler, Ravi Shroff, Sharad GoelICML 2022 · 52 citations
Related papers
- Multi-Task Learning for Randomized Controlled Trials: A Case Study on Predicting Depression with Wearable DataRuixuan Dai, Thomas George Kannampallil, Jingwen Zhang, Nan Lv et al.UbiComp 2022 · 39 citations
- Meta-Learning Helps Personalized Product SearchBin Wu, Zaiqiao Meng, Qiang Zhang, Shangsong LiangWWW 2022 · 14 citations
- Zero-Shot Task Adaptation with Relevant Feature InformationAtsutoshi Kumagai, Tomoharu Iwata, Yasuhiro FujiwaraAAAI 2024 · 1 citation
- An Orthogonal Learner for Individualized Outcomes in Markov Decision ProcessesEmil Javurek, Valentyn Melnychuk, Jonas Schweisthal, Konstantin Hess et al.ICLR 2026 · 2 citations
- LLM-Driven Treatment Effect Estimation Under Inference Time Text ConfoundingYuchen Ma, Dennis Frauen, Jonas Schweisthal, Stefan FeuerriegelNeurIPS 2025 · 7 citations
