Generative Modeling from Black-Box Corruptions via Self-Consistent Stochastic Interpolants
Chirag Modi, Jiequn Han, Eric Vanden-Eijnden, Joan Bruna
Abstract
Transport-based methods have emerged as a leading paradigm for building generative models from large, clean datasets. However, in many scientific and engineering domains, clean data are often unavailable: instead, we only observe measurements corrupted through a noisy, ill-conditioned channel. A generative model for the original data thus requires solving an inverse problem at the level of distributions. In this work, we introduce a novel approach to this task based on Stochastic Interpolants: we iteratively update a transport map between corrupted and clean data samples using only access to the corrupted dataset as well as black box access to the corruption channel. Under appropriate conditions, this iterative procedure converges towards a self-consistent transport map that effectively inverts the corruption channel, thus enabling a generative model for the clean data. We refer to the resulting method as the self-consistent stochastic interpolant (SCSI). It (i) is computationally efficient compared to variational alternatives, (ii) highly flexible, handling arbitrary nonlinear forward models with only black-box access, and (iii) enjoys theoretical guarantees. We demonstrate superior performance on inverse problems in natural image processing and scientific reconstruction, and establish convergence guarantees of the scheme under appropriate assumptions. Our source code is publicly available at https://github.com/modichirag/SCSI .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cf77d002-239b-44d0-9cca-c58904cfce94Builds on20
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Discrete Flow MatchingItai Gat, Tal Remez, Neta Shaul, Felix Kreuk et al.NeurIPS 2024 · 363 citations
Related papers
- SFBD-OMNI: Bridge models for lossy measurement restoration with limited clean samplesHaoye Lu, Yaoliang Yu, Darren LoICLR 2026
- Stochastic Interpolants with Data-Dependent CouplingsMichael S. Albergo, Mark Goldstein, Nicholas Matthew Boffi, Rajesh Ranganath et al.ICML 2024 · 73 citations
- UOTIP: Unbalanced Optimal Transport Map for Unpaired Inverse ProblemsDonggyu Lee, Taekyung Lee, Jaewoong ChoiICML 2026
- Inverse Problem Sampling in Latent Space Using Sequential Monte CarloIdan Achituve, Hai Victor Habi, Amir Rosenfeld, Arnon Netzer et al.ICML 2025
- Multimarginal Generative Modeling with Stochastic InterpolantsMichael S. Albergo, Nicholas Matthew Boffi, Michael Lindsey, Eric Vanden-EijndenICLR 2024 · 19 citations
