Continuous Degradation Modeling via Latent Flow Matching for Real-World Super-Resolution
Hyeonjae Kim, Dongjin Kim, Eugene Jin, Tae Hyun Kim
Abstract
While deep learning-based super-resolution (SR) methods have shown impressive outcomes with synthetic degradation scenarios such as bicubic downsampling, they frequently struggle to perform well on real-world images that feature complex, nonlinear degradations like noise, blur, and compression artifacts. Recent efforts to address this issue have involved the painstaking compilation of real low-resolution (LR) and high-resolution (HR) image pairs, usually limited to several specific downscaling factors. To address these challenges, our work introduces a novel framework capable of synthesizing authentic LR images from a single HR image by leveraging the latent degradation space with flow matching. Our approach generates LR images with realistic artifacts at unseen degradation levels, which facilitates the creation of large-scale, real-world SR training datasets. Comprehensive quantitative and qualitative assessments verify that our synthetic LR images accurately replicate real-world degradations. Furthermore, both traditional and arbitrary-scale SR models trained using our datasets consistently yield much better HR outcomes.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 35cb8342-bc27-4d80-a55d-5a1608f4affdCited by top-tier papers1
Ask how each one uses itBuilds on16
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- SDXL: Improving Latent Diffusion Models for High-Resolution Image SynthesisDustin Podell, Zion English, Kyle Lacey, Andreas Blattmann et al.ICLR 2024 · 4,569 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Designing a Practical Degradation Model for Deep Blind Image Super-ResolutionKai Zhang, Jingyun Liang, Luc Van Gool, Radu TimofteICCV 2021 · 898 citations
Related papers
- Learning Controllable Degradation for Real-World Super-Resolution via Constrained FlowsSeobin Park, Dongjin Kim, Sungyong Baik, Tae Hyun KimICML 2023 · 8 citations
- Learning Generalizable Latent Representations for Novel Degradations in Super-ResolutionFengjun Li, Xin Feng, Fanglin Chen, Guangming Lu et al.ACM MM 2022 · 5 citations
- Towards Realistic Data Generation for Real-World Super-ResolutionLong Peng, Wenbo Li, Renjing Pei, Jingjing Ren et al.ICLR 2025
- DeFlow: Learning Complex Image Degradations From Unpaired Data With Conditional FlowsValentin Wolf, Andreas Lugmayr, Martin Danelljan, Luc Van Gool et al.CVPR 2021
- Unsupervised Real-World Super-Resolution: A Domain Adaptation PerspectiveWei Wang, Haochen Zhang, Zehuan Yuan, Changhu WangICCV 2021 · 67 citations
