FRAMER: Frequency-Aligned Self-Distillation with Adaptive Modulation Leveraging Diffusion Priors for Real-World Image Super-Resolution
Seungho Choi, Jeahun Sung, Jihyong Oh
摘要
Real-image super-resolution (Real-ISR) seeks to recover HR images from LR inputs with mixed, unknown degradations. While diffusion models surpass GANs in perceptual quality, they under-reconstruct high-frequency (HF) details due to a low-frequency (LF) bias and a depth-wise"low-first, high-later"hierarchy. We introduce FRAMER, a plug-and-play training scheme that exploits diffusion priors without changing the backbone or inference. At each denoising step, the final-layer feature map teaches all intermediate layers. Teacher and student feature maps are decomposed into LF/HF bands via FFT masks to align supervision with the model's internal frequency hierarchy. For LF, an Intra Contrastive Loss (IntraCL) stabilizes globally shared structure. For HF, an Inter Contrastive Loss (InterCL) sharpens instance-specific details using random-layer and in-batch negatives. Two adaptive modulators, Frequency-based Adaptive Weight (FAW) and Frequency-based Alignment Modulation (FAM), reweight per-layer LF/HF signals and gate distillation by current similarity. Across U-Net and DiT backbones (e.g., Stable Diffusion 2, 3), FRAMER consistently improves PSNR/SSIM and perceptual metrics (LPIPS, NIQE, MANIQA, MUSIQ). Ablations validate the final-layer teacher and random-layer negatives.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper19
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 被引用 11,349 次
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 被引用 5,568 次
- Scaling Rectified Flow Transformers for High-Resolution Image SynthesisPatrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari 等ICML 2024 · 被引用 3,620 次
相关 Paper
- FiDeSR: High-Fidelity and Detail-Preserving One-Step Diffusion Super-ResolutionAro Kim, Myeongjin Jang, Chaewon Moon, Youngjin Shin 等CVPR 2026 · 被引用 3 次
- One-Step Residual Shifting Diffusion for Image Super-Resolution via DistillationDaniil Selikhanovych, David Li, Aleksei Leonov, Nikita Gushchin 等ICML 2026 · 被引用 3 次
- SSL: A Self-similarity Loss for Improving Generative Image Super-resolutionDu Chen, Zhengqiang Zhang, Jie Liang, Lei ZhangACM MM 2024 · 被引用 7 次
- Disentangled Textual Priors for Diffusion-based Image Super-ResolutionLei Jiang, Xin Liu, Xinze Tong, Zhiliang Li 等CVPR 2026 · 被引用 2 次
- Beyond the Ground Truth: Enhanced Supervision for Image RestorationDonghun Ryou, Inju Ha, Sanghyeok Chu, Bohyung HanCVPR 2026 · 被引用 4 次
