High Fidelity Image Counterfactuals with Probabilistic Causal Models
Fabio De Sousa Ribeiro, Tian Xia, Miguel Monteiro, Nick Pawlowski, Ben Glocker
Abstract
We present a general causal generative modelling framework for accurate estimation of high fidelity image counterfactuals with deep structural causal models. Estimation of interventional and counterfactual queries for high-dimensional structured variables, such as images, remains a challenging task. We leverage ideas from causal mediation analysis and advances in generative modelling to design new deep causal mechanisms for structured variables in causal models. Our experiments demonstrate that our proposed mechanisms are capable of accurate abduction and estimation of direct, indirect and total effects as measured by axiomatic soundness of counterfactuals.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 299bbff9-0e1a-4090-ae6a-322684e018aeCited by top-tier papers14
- Conditional Generative Models are Sufficient to Sample from Any Causal Effect EstimandMd. Musfiqur Rahman, Matt Jordan, Murat KocaogluNeurIPS 2024 · 7 citations
- Counterfactual Identifiability via Dynamic Optimal TransportFabio De Sousa Ribeiro, Ainkaran Santhirasekaram, Ben GlockerNeurIPS 2025 · 7 citations
- Counterfactual Image Editing with Disentangled Causal Latent SpaceYushu Pan, Elias BareinboimNeurIPS 2025 · 7 citations
- Flow Stochastic Segmentation NetworksFabio De Sousa Ribeiro, Omar Todd, Charles Jones, Avinash Kori et al.ICCV 2025 · 4 citations
- Exogenous Matching: Learning Good Proposals for Tractable Counterfactual EstimationYikang Chen, Dehui Du, Lili TianNeurIPS 2024 · 3 citations
Builds on20
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- Palette: Image-to-Image Diffusion ModelsChitwan Saharia, William Chan, Huiwen Chang, Chris A. Lee et al.SIGGRAPH 2022 · 1,638 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
Related papers
- Measuring axiomatic soundness of counterfactual image modelsMiguel Monteiro, Fabio De Sousa Ribeiro, Nick Pawlowski, Daniel C. Castro et al.ICLR 2023 · 2 citations
- Counterfactual Image EditingYushu Pan, Elias BareinboimICML 2024 · 19 citations
- Causal Abstraction Inference under Lossy RepresentationsKevin Muyuan Xia, Elias BareinboimICML 2025
- Deep Structural Causal Models for Tractable Counterfactual InferenceNick Pawlowski, Daniel Coelho de Castro, Ben GlockerNeurIPS 2020 · 353 citations
- Counterfactual Generative Modeling with Variational Causal InferenceYulun Wu, Louie McConnell, Claudia IriondoICLR 2025
