Realism Control One-step Diffusion for Real-world Image Super Resolution
Zongliang Wu, Siming Zheng, Peng-Tao Jiang, Xin Yuan
Abstract
Pre-trained diffusion models have shown great potential in real-world image super-resolution (Real-ISR) tasks by enabling high-resolution reconstructions. While one-step diffusion (OSD) methods significantly improve efficiency compared to traditional multi-step approaches, they still have limitations in balancing fidelity and realism across diverse scenarios. Since the OSDs for SR are usually trained or distilled by a single timestep, they lack flexible control mechanisms to adaptively prioritize these competing objectives, which are inherently manageable in multi-step methods through adjusting sampling steps. To address this challenge, we propose a Realism Controlled One-step Diffusion (RCOD) framework for Real-ISR. RCOD provides a latent domain grouping strategy that enables explicit control over fidelity-realism trade-offs during the noise prediction phase with minimal training paradigm modifications and original training data. A degradation-aware sampling strategy is also introduced to align distillation regularization with the grouping strategy and enhance the controlling of trade-offs. Moreover, a visual prompt injection module is used to replace conventional text prompts with degradation-aware visual tokens, enhancing both restoration accuracy and semantic consistency. Our method achieves superior fidelity and perceptual quality while maintaining computational efficiency. Extensive experiments demonstrate that RCOD outperforms state-of-the-art OSD methods quantitatively and visually, with flexible realism control capabilities in the inference stage. Code is available at https://zongliang-wu.github.io/RCOD-SR .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- Joint Geometric and Trajectory Consistency Learning for One-Step Real-World Super-ResolutionChengyan Deng, Zhangquan Chen, Li Yu, Kai Zhang et al.ICML 2026 · 2 citations
- Towards Photorealistic and Efficient Bokeh Rendering via Diffusion FrameworkLinxiao Shi, Siming Zheng, Zerong Wang, Hao Zhang et al.CVPR 2026
- IFCSR: Inference-Free Fidelity-Realism Control for One-Step Diffusion-based Real-World Image Super-ResolutionJonghee Back, Jongju Kim, Jeong-Uk Kim, Eunjin Kim et al.CVPR 2026
Builds on21
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 6,759 citations
- Consistency ModelsYang Song, Prafulla Dhariwal, Mark Chen, Ilya SutskeverICML 2023 · 1,720 citations
Related papers
- One-Step Effective Diffusion Network for Real-World Image Super-ResolutionRongyuan Wu, Lingchen Sun, Zhiyuan Ma, Lei ZhangNeurIPS 2024 · 319 citations
- Time-Aware One Step Diffusion Network for Real-World Image Super-ResolutionTianyi Zhang, Zheng-Peng Duan, Chun-Le Guo, Peng-Tao Jiang et al.CVPR 2026 · 6 citations
- Bridging Fidelity-Reality with Controllable One-Step Diffusion for Image Super-ResolutionHao Chen, Junyang Chen, Jinshan Pan, Jiangxin DongCVPR 2026 · 4 citations
- TSD-SR: One-Step Diffusion with Target Score Distillation for Real-World Image Super-ResolutionLinwei Dong, Qingnan Fan, Yihong Guo, Zhonghao Wang et al.CVPR 2025
- One-Step Diffusion Transformer for Controllable Real-World Image Super-ResolutionYushun Fang, Yuxiang Chen, Shibo Yin, Qiang Hu et al.CVPR 2026 · 9 citations
