Realism Control One-step Diffusion for Real-world Image Super Resolution
Zongliang Wu, Siming Zheng, Peng-Tao Jiang, Xin Yuan
摘要
Pre-trained diffusion models have shown great potential in real-world image super-resolution (Real-ISR) tasks by enabling high-resolution reconstructions. While one-step diffusion (OSD) methods significantly improve efficiency compared to traditional multi-step approaches, they still have limitations in balancing fidelity and realism across diverse scenarios. Since the OSDs for SR are usually trained or distilled by a single timestep, they lack flexible control mechanisms to adaptively prioritize these competing objectives, which are inherently manageable in multi-step methods through adjusting sampling steps. To address this challenge, we propose a Realism Controlled One-step Diffusion (RCOD) framework for Real-ISR. RCOD provides a latent domain grouping strategy that enables explicit control over fidelity-realism trade-offs during the noise prediction phase with minimal training paradigm modifications and original training data. A degradation-aware sampling strategy is also introduced to align distillation regularization with the grouping strategy and enhance the controlling of trade-offs. Moreover, a visual prompt injection module is used to replace conventional text prompts with degradation-aware visual tokens, enhancing both restoration accuracy and semantic consistency. Our method achieves superior fidelity and perceptual quality while maintaining computational efficiency. Extensive experiments demonstrate that RCOD outperforms state-of-the-art OSD methods quantitatively and visually, with flexible realism control capabilities in the inference stage. Code is available at https://zongliang-wu.github.io/RCOD-SR .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper3
- Joint Geometric and Trajectory Consistency Learning for One-Step Real-World Super-ResolutionChengyan Deng, Zhangquan Chen, Li Yu, Kai Zhang 等ICML 2026 · 被引用 2 次
- Towards Photorealistic and Efficient Bokeh Rendering via Diffusion FrameworkLinxiao Shi, Siming Zheng, Zerong Wang, Hao Zhang 等CVPR 2026
- IFCSR: Inference-Free Fidelity-Realism Control for One-Step Diffusion-based Real-World Image Super-ResolutionJonghee Back, Jongju Kim, Jeong-Uk Kim, Eunjin Kim 等CVPR 2026
它引用的顶会 Paper21
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 被引用 6,759 次
- Consistency ModelsYang Song, Prafulla Dhariwal, Mark Chen, Ilya SutskeverICML 2023 · 被引用 1,720 次
相关 Paper
- One-Step Effective Diffusion Network for Real-World Image Super-ResolutionRongyuan Wu, Lingchen Sun, Zhiyuan Ma, Lei ZhangNeurIPS 2024 · 被引用 319 次
- Time-Aware One Step Diffusion Network for Real-World Image Super-ResolutionTianyi Zhang, Zheng-Peng Duan, Chun-Le Guo, Peng-Tao Jiang 等CVPR 2026 · 被引用 6 次
- Bridging Fidelity-Reality with Controllable One-Step Diffusion for Image Super-ResolutionHao Chen, Junyang Chen, Jinshan Pan, Jiangxin DongCVPR 2026 · 被引用 4 次
- TSD-SR: One-Step Diffusion with Target Score Distillation for Real-World Image Super-ResolutionLinwei Dong, Qingnan Fan, Yihong Guo, Zhonghao Wang 等CVPR 2025
- One-Step Diffusion Transformer for Controllable Real-World Image Super-ResolutionYushun Fang, Yuxiang Chen, Shibo Yin, Qiang Hu 等CVPR 2026 · 被引用 9 次
