FreeAdapt: Unleashing Diffusion Priors for Ultra-High-Definition Image Restoration
Xiaoan Liu, Xinyi Liu, Yongjun Zhang, Yi Wan, Tingyun Li, Dongdong Yue
摘要
Latent Diffusion Models (LDMs) have recently shown great potential for image restoration owing to their powerful generative priors. However, directly applying them to ultra-high-definition image restoration (UHD-IR) often results in severe global inconsistencies and loss of fine-grained details, primarily caused by patchbased inference and the information bottleneck of the VAE. To overcome these issues, we present FreeAdapt, a plug-and-play framework that unleashes the capability of diffusion priors for UHD-IR. The core of FreeAdapt is a training-free Frequency Feature Synergistic Guidance (FFSG) mechanism, which introduces guidance at each denoising step during inference time. It consists of two modules: 1) Frequency Guidance (FreqG) selectively fuses phase information from a reference image in the frequency domain to enforce structural consistency across the entire image; 2) Feature Guidance (FeatG) injects global contextual information into the self-attention layers of the U-Net, effectively suppressing unrealistic textures in smooth regions and preserving local detail fidelity. In addition, FreeAdapt includes an optional VAE fine-tuning module, where skip connection further enhances the reconstruction of fine-grained textures. Extensive experiments demonstrate that our method achieves superior quantitative performance and visual quality compared to state-of-the-art UHD-IR approaches, and consistently delivers strong gains across multiple LDM-based backbones. Recently, Latent Diffusion Models (LDMs) (Rombach et al., 2022) have shown remarkable potential in low-level vision tasks owing to their powerful generative priors (Lin et al., 2024a; Wu et al., 2024c;b; Yue et al., 2025; Chen et al., 2025a; Sun et al., 2025) . However, directly applying these pre-trained models to UHD-IR faces several technical bottlenecks. First, due to the high computa- RELATED WORK Ultra-High-Definition Image Restoration. UHD-IR has gained increasing attention due to the rapidly growing demand for high-resolution images
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper36
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 被引用 6,759 次
- Restormer: Efficient Transformer for High-Resolution Image RestorationSyed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat 等CVPR 2022 · 被引用 3,348 次
相关 Paper
- FaithDiff: Unleashing Diffusion Priors for Faithful Image Super-resolutionJunyang Chen, Jinshan Pan, Jiangxin DongCVPR 2025
- FreeInpaint: Tuning-free Prompt Alignment and Visual Rationality Enhancement in Image InpaintingChao Gong, Dong Li, Yingwei Pan, Jingjing Chen 等AAAI 2026
- Frequency-Guided Diffusion for Training-Free Text-Driven Image TranslationZheng Gao, Jifei Song, Zhensong Zhang, Jiankang Deng 等ICCV 2025 · 被引用 1 次
- DreamUHD: Frequency Enhanced Variational Autoencoder for Ultra-High-Definition Image RestorationYidi Liu, Dong Li, Jie Xiao, Yuanfei Bao 等AAAI 2025 · 被引用 11 次
- Self-Adaptive Reality-Guided Diffusion for Artifact-Free Super-ResolutionQingping Zheng, Ling Zheng, Yuanfan Guo, Ying Li 等CVPR 2024 · 被引用 8 次
