Solving Inverse Problems with FLAIR
Julius Erbach, Dominik Narnhofer, Andreas Dombos, Bernt Schiele, Jan Eric Lenssen, Konrad Schindler
Abstract
Flow-based latent generative models such as Stable Diffusion 3 are able to generate images with remarkable quality, even enabling photorealistic text-to-image generation. Their impressive performance suggests that these models should also constitute powerful priors for inverse imaging problems, but that approach has not yet led to comparable fidelity. There are several key obstacles: (i) the data likelihood term is usually intractable; (ii) learned generative models cannot be directly conditioned on the distorted observations, leading to conflicting objectives between data likelihood and prior; and (iii) the reconstructions can deviate from the observed data. We present FLAIR, a novel, training-free variational framework that leverages flow-based generative models as prior for inverse problems. To that end, we introduce a variational objective for flow matching that is agnostic to the type of degradation, and combine it with deterministic trajectory adjustments to guide the prior towards regions which are more likely under the posterior. To enforce exact consistency with the observed data, we decouple the optimization of the data fidelity and regularization terms. Moreover, we introduce a time-dependent calibration scheme in which the strength of the regularization is modulated according to off-line accuracy estimates. Results on standard imaging benchmarks demonstrate that FLAIR consistently outperforms existing diffusion-and flow-based methods in terms of reconstruction quality and sample diversity. Source code is available at https://inverseflair.github.io/.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers7
- A Unified Solution to Video Fusion: From Multi-Frame Learning to BenchmarkingZixiang Zhao, Haowen Bai, Bingxin Ke, Yukun Cui et al.NeurIPS 2025 · 21 citations
- Residual Diffusion Bridge Model for Image RestorationHebaixu Wang, Jing Zhang, Haoyang Chen, Haonan Guo et al.CVPR 2026 · 16 citations
- A Statistical Benchmark for Diffusion-Posterior-Sampling AlgorithmsMartin Zach, Youssef Haouchat, Michael UnserICLR 2026 · 8 citations
- Efficient Zero-shot Inpainting with Decoupled Diffusion GuidanceBadr Moufad, Yazid Janati El Idrissi, Navid Bagheri Shouraki, Alain Oliviero Durmus et al.ICLR 2026 · 7 citations
- Solving Inverse Problems with Flow-based Models via Model Predictive ControlGeorge Webber, Alexander Denker, Riccardo Barbano, Andrew ReaderICML 2026 · 1 citation
Builds on30
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
- Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 3,959 citations
- Scaling Rectified Flow Transformers for High-Resolution Image SynthesisPatrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari et al.ICML 2024 · 3,620 citations
Related papers
- FlowAlign: Trajectory-Regularized, Inversion-Free Flow-based Image EditingJeongsol Kim, Yeobin Hong, Jonghyun Park, Jong Chul YeICLR 2026 · 35 citations
- FlowDPS: Flow-Driven Posterior Sampling for Inverse ProblemsJeongsol Kim, Bryan Sangwoo Kim, Jong Chul YeICCV 2025 · 6 citations
- DNF-Intrinsic: Deterministic Noise-Free Diffusion for Indoor Inverse RenderingRongjia Zheng, Qing Zhang, Chengjiang Long, Wei-Shi ZhengICCV 2025 · 2 citations
- Latent Refinement via Flow Matching for Training-free Linear Inverse Problem SolvingHossein Askari, Yadan Luo, Hongfu Sun, Fred RoostaNeurIPS 2025 · 2 citations
- Learning Normalized Energy Models for Linear Inverse ProblemsNicolas M Zilberstein, Santiago Segarra, Eero Simoncelli, Florentin GuthICML 2026
