Beyond the Ground Truth: Enhanced Supervision for Image Restoration
Donghun Ryou, Inju Ha, Sanghyeok Chu, Bohyung Han
Abstract
Deep learning-based image restoration has achieved significant success. However, when addressing real-world degradations, model performance is limited by the quality of groundtruth images in datasets due to practical constraints in data acquisition. To address this limitation, we propose a novel framework that enhances existing ground truth images to provide higher-quality supervision for real-world restoration. Our framework generates perceptually enhanced ground truth images using super-resolution by incorporating adaptive frequency masks, which are learned by a conditional frequency mask generator. These masks guide the optimal fusion of frequency components from the original ground truth and its super-resolved variants, yielding enhanced ground truth images. This frequency-domain mixup preserves the semantic consistency of the original content while selectively enriching perceptual details, preventing hallucinated artifacts that could compromise fidelity. The enhanced ground truth images are used to train a lightweight output refinement network that can be seamlessly integrated with existing restoration models. Extensive experiments demonstrate that our approach improves the quality of restored images. We further validate the effectiveness of both supervision enhancement and output refinement through user studies.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f35c89f7-41df-4ff0-9cb6-6c3824997f5bBuilds on24
- Restormer: Efficient Transformer for High-Resolution Image RestorationSyed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat et al.CVPR 2022 · 3,348 citations
- Denoising Diffusion Restoration ModelsBahjat Kawar, Michael Elad, Stefano Ermon, Jiaming SongNeurIPS 2022 · 1,439 citations
- MUSIQ: Multi-scale Image Quality TransformerJunjie Ke, Qifei Wang, Yilin Wang, Peyman Milanfar et al.ICCV 2021 · 1,325 citations
- Retinexformer: One-stage Retinex-based Transformer for Low-light Image EnhancementYuanhao Cai, Hao Bian, Jing Lin, Haoqian Wang et al.ICCV 2023 · 615 citations
- DiffIR: Efficient Diffusion Model for Image RestorationBin Xia, Yulun Zhang, Shiyin Wang, Yitong Wang et al.ICCV 2023 · 410 citations
Related papers
- Human Guided Ground-Truth Generation for Realistic Image Super-ResolutionDu Chen, Jie Liang, Xindong Zhang, Ming Liu et al.CVPR 2023
- Robust Real-World Image Super-Resolution against Adversarial AttacksJiutao Yue, Haofeng Li, Pengxu Wei, Guanbin Li et al.ACM MM 2021 · 20 citations
- Continuous Degradation Modeling via Latent Flow Matching for Real-World Super-ResolutionHyeonjae Kim, Dongjin Kim, Eugene Jin, Tae Hyun KimAAAI 2026 · 1 citation
- AND: Adversarial Neural Degradation for Learning Blind Image Super-ResolutionFangzhou Luo, Xiaolin Wu, Yanhui GuoNeurIPS 2023 · 11 citations
- Robust Image Denoising Through Adversarial Frequency MixupDonghun Ryou, Inju Ha, Hyewon Yoo, Dongwan Kim et al.CVPR 2024 · 13 citations
