Counterfactual Density Estimation using Kernel Stein Discrepancies
Diego Martinez-Taboada, Edward Kennedy
Abstract
Causal effects are usually studied in terms of the means of counterfactual distributions, which may be insufficient in many scenarios. Given a class of densities known up to normalizing constants, we propose to model counterfactual distributions by minimizing kernel Stein discrepancies in a doubly robust manner. This enables the estimation of counterfactuals over large classes of distributions while exploiting the desired double robustness. We present a theoretical analysis of the proposed estimator, providing sufficient conditions for consistency and asymptotic normality, as well as an examination of its empirical performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext df9af5ee-a9bd-427e-9eca-42623c40dcf2Cited by top-tier papers2
- Quantifying Aleatoric Uncertainty of the Treatment Effect: A Novel Orthogonal LearnerValentyn Melnychuk, Stefan Feuerriegel, Mihaela van der SchaarNeurIPS 2024 · 13 citations
- GDR-learners: Orthogonal Learning of Generative Models for Potential OutcomesValentyn Melnychuk, Stefan FeuerriegelICLR 2026 · 1 citation
Builds on3
- Kernel Stein Discrepancy DescentAnna Korba, Pierre-Cyril Aubin-Frankowski, Szymon Majewski, Pierre AblinICML 2021 · 64 citations
- Conditional Distributional Treatment Effect with Kernel Conditional Mean Embeddings and U-Statistic RegressionJunhyung Park, Uri Shalit, Bernhard Schölkopf, Krikamol MuandetICML 2021 · 46 citations
- An Efficient Doubly-Robust Test for the Kernel Treatment EffectDiego Martinez-Taboada, Aaditya Ramdas, Edward KennedyNeurIPS 2023 · 17 citations
Related papers
- Normalizing Flows for Interventional Density EstimationValentyn Melnychuk, Dennis Frauen, Stefan FeuerriegelICML 2023 · 25 citations
- Doubly-Robust Estimation of Counterfactual Policy Mean EmbeddingsHoussam Zenati, Bariscan Bozkurt, Arthur GrettonNeurIPS 2025 · 3 citations
- Falsification before Extrapolation in Causal Effect EstimationZeshan M. Hussain, Michael Oberst, Ming-Chieh Shih, David A. SontagNeurIPS 2022 · 11 citations
- Doubly Robust Counterfactual ClassificationKwangho Kim, Edward H. Kennedy, José R. ZubizarretaNeurIPS 2022 · 9 citations
- Density Ratio-Free Doubly Robust Proxy Causal LearningBariscan Bozkurt, Houssam Zenati, Dimitri Meunier, Liyuan Xu et al.NeurIPS 2025 · 2 citations
