Multitask Learning with Stochastic Interpolants
Hugo Negrel, Florentin Coeurdoux, Michael S. Albergo, Eric Vanden-Eijnden
Abstract
We propose a framework for learning maps between probability distributions that broadly generalizes the time dynamics of flow and diffusion models. To enable this, we generalize stochastic interpolants by replacing the scalar time variable with vectors, matrices, or linear operators, allowing us to bridge probability distributions across multiple dimensional spaces. This approach enables the construction of versatile generative models capable of fulfilling multiple tasks without task-specific training. Our operator-based interpolants not only provide a unifying theoretical perspective for existing generative models but also extend their capabilities. Through numerical experiments, we demonstrate the zero-shot efficacy of our method on conditional generation and inpainting, fine-tuning and posterior sampling, and multiscale modeling, suggesting its potential as a generic task-agnostic alternative to specialized models.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Any-Order Flexible Length Masked DiffusionJaeyeon Kim, Cheuk Lee Kit, Carles Domingo-Enrich, Yilun Du et al.ICLR 2026 · 51 citations
- Learning Normalized Energy Models for Linear Inverse ProblemsNicolas M Zilberstein, Santiago Segarra, Eero Simoncelli, Florentin GuthICML 2026
Builds on22
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Denoising Diffusion Restoration ModelsBahjat Kawar, Michael Elad, Stefano Ermon, Jiaming SongNeurIPS 2022 · 1,439 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale PredictionKeyu Tian, Yi Jiang, Zehuan Yuan, Bingyue Peng et al.NeurIPS 2024 · 1,199 citations
Related papers
- Stochastic Interpolants with Data-Dependent CouplingsMichael S. Albergo, Mark Goldstein, Nicholas Matthew Boffi, Rajesh Ranganath et al.ICML 2024 · 73 citations
- Stochastic Process Learning via Operator Flow MatchingYaozhong Shi, Zachary E. Ross, Domniki Asimaki, Kamyar AzizzadenesheliNeurIPS 2025 · 13 citations
- Test-time Generalization for Physics through Neural Operator SplittingLouis Serrano, Jiequn Han, Edouard Oyallon, Shirley Ho et al.ICML 2026 · 4 citations
- Improving Diffusion Models for Inverse Problems Using Optimal Posterior CovarianceXinyu Peng, Ziyang Zheng, Wenrui Dai, Nuoqian Xiao et al.ICML 2024 · 47 citations
- Going beyond Compositions, DDPMs Can Produce Zero-Shot InterpolationsJustin Deschenaux, Igor Krawczuk, Grigorios Chrysos, Volkan CevherICML 2024 · 6 citations
