Generative Modeling from Black-Box Corruptions via Self-Consistent Stochastic Interpolants
Chirag Modi, Jiequn Han, Eric Vanden-Eijnden, Joan Bruna
摘要
Transport-based methods have emerged as a leading paradigm for building generative models from large, clean datasets. However, in many scientific and engineering domains, clean data are often unavailable: instead, we only observe measurements corrupted through a noisy, ill-conditioned channel. A generative model for the original data thus requires solving an inverse problem at the level of distributions. In this work, we introduce a novel approach to this task based on Stochastic Interpolants: we iteratively update a transport map between corrupted and clean data samples using only access to the corrupted dataset as well as black box access to the corruption channel. Under appropriate conditions, this iterative procedure converges towards a self-consistent transport map that effectively inverts the corruption channel, thus enabling a generative model for the clean data. We refer to the resulting method as the self-consistent stochastic interpolant (SCSI). It (i) is computationally efficient compared to variational alternatives, (ii) highly flexible, handling arbitrary nonlinear forward models with only black-box access, and (iii) enjoys theoretical guarantees. We demonstrate superior performance on inverse problems in natural image processing and scientific reconstruction, and establish convergence guarantees of the scheme under appropriate assumptions. Our source code is publicly available at https://github.com/modichirag/SCSI .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper20
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 被引用 13,211 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar 等ICLR 2021 · 被引用 1,270 次
- Discrete Flow MatchingItai Gat, Tal Remez, Neta Shaul, Felix Kreuk 等NeurIPS 2024 · 被引用 363 次
相关 Paper
- SFBD-OMNI: Bridge models for lossy measurement restoration with limited clean samplesHaoye Lu, Yaoliang Yu, Darren LoICLR 2026
- Stochastic Interpolants with Data-Dependent CouplingsMichael S. Albergo, Mark Goldstein, Nicholas Matthew Boffi, Rajesh Ranganath 等ICML 2024 · 被引用 73 次
- UOTIP: Unbalanced Optimal Transport Map for Unpaired Inverse ProblemsDonggyu Lee, Taekyung Lee, Jaewoong ChoiICML 2026
- Inverse Problem Sampling in Latent Space Using Sequential Monte CarloIdan Achituve, Hai Victor Habi, Amir Rosenfeld, Arnon Netzer 等ICML 2025
- Multimarginal Generative Modeling with Stochastic InterpolantsMichael S. Albergo, Nicholas Matthew Boffi, Michael Lindsey, Eric Vanden-EijndenICLR 2024 · 被引用 19 次
