Energy-oriented Diffusion Bridge for Image Restoration with Foundational Diffusion Models
Jinhui HOU, Zhiyu Zhu, Junhui Hou
摘要
Diffusion bridge models have shown great promise in image restoration by explicitly connecting clean and degraded image distributions. However, they often rely on complex and high-cost trajectories, which limit both sampling efficiency and final restoration quality. To address this, we propose an Energy-oriented diffusion Bridge (E-Bridge) framework to approximate a set of low-cost manifold geodesic trajectories to boost the performance of the proposed method. We achieve this by designing a novel bridge process that evolves over a shorter time horizon and makes the reverse process start from an entropy-regularized point that mixes the degraded image and Gaussian noise, which theoretically reduces the required trajectory energy. To solve this process efficiently, we draw inspiration from consistency models to learn a single-step mapping function, optimized via a continuous-time consistency objective tailored for our trajectory, so as to analytically map any state on the trajectory to the target image. Notably, the trajectory length in our framework becomes a tunable task-adaptive knob, allowing the model to adaptively balance information preservation against generative power for tasks of varying degradation, such as denoising versus super-resolution. Extensive experiments demonstrate that our E-Bridge achieves state-of-the-art performance across various image restoration tasks while enabling high-quality recovery with a single or fewer sampling steps. Our project page is https://jinnh.github.io/E-Bridge/.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper24
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 被引用 13,211 次
- Consistency ModelsYang Song, Prafulla Dhariwal, Mark Chen, Ilya SutskeverICML 2023 · 被引用 1,720 次
- Denoising Diffusion Restoration ModelsBahjat Kawar, Michael Elad, Stefano Ermon, Jiaming SongNeurIPS 2022 · 被引用 1,439 次
- RePaint: Inpainting using Denoising Diffusion Probabilistic ModelsAndreas Lugmayr, Martin Danelljan, Andrés Romero, Fisher Yu 等CVPR 2022 · 被引用 1,425 次
相关 Paper
- Consistency Diffusion Bridge ModelsGuande He, Kaiwen Zheng, Jianfei Chen, Fan Bao 等NeurIPS 2024 · 被引用 31 次
- Direct Diffusion Bridge using Data Consistency for Inverse ProblemsHyungjin Chung, Jeongsol Kim, Jong Chul YeNeurIPS 2023 · 被引用 86 次
- Efficient Generative Modeling beyond Memoryless Diffusion via Adjoint Schrödinger Bridge MatchingJeongwoo Shin, Jinhwan Sul, Joonseok Lee, Jaewoong Choi 等ICML 2026
- IRBridge: Solving Image Restoration Bridge with Pre-trained Generative Diffusion ModelsHanting Wang, Tao Jin, Wang Lin, Shulei Wang 等ICML 2025
- Residual Diffusion Bridge Model for Image RestorationHebaixu Wang, Jing Zhang, Haoyang Chen, Haonan Guo 等CVPR 2026 · 被引用 16 次
