DynFaceRestore: Balancing Fidelity and Quality in Diffusion-Guided Blind Face Restoration with Dynamic Blur-Level Mapping and Guidance
Huu-Phu Do, Yu-Wei Chen, Yi-Cheng Liao, Chi-Wei Hsiao, Han-Yang Wang, Wei-Chen Chiu, Ching-Chun Huang
摘要
Blind Face Restoration aims to recover high-fidelity, detail-rich facial images from unknown degraded inputs, presenting significant challenges in preserving both identity and detail. Pre-trained diffusion models have been increasingly used as image priors to generate fine details. Still, existing methods often use fixed diffusion sampling timesteps and a global guidance scale, assuming uniform degradation. This limitation and potentially imperfect degradation kernel estimation frequently lead to under- or over-diffusion, resulting in an imbalance between fidelity and quality. We propose DynFaceRestore, a novel blind face restoration approach that learns to map any blindly degraded input to Gaussian blurry images. By leveraging these blurry images and their respective Gaussian kernels, we dynamically select the starting timesteps for each blurry image and apply closed-form guidance during the diffusion sampling process to maintain fidelity. Additionally, we introduce a dynamic guidance scaling adjuster that modulates the guidance strength across local regions, enhancing detail generation in complex areas while preserving structural fidelity in contours. This strategy effectively balances the trade-off between fidelity and quality. DynFaceRestore achieves state-of-the-art performance in both quantitative and qualitative evaluations, demonstrating robustness and effectiveness in blind face restoration. Project page at https://nycu-acm.github.io/DynFaceRestore/
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper19
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Directly Denoising Diffusion ModelsDan Zhang, Jingjing Wang, Feng LuoICML 2024 · 被引用 11,724 次
- Denoising Diffusion Restoration ModelsBahjat Kawar, Michael Elad, Stefano Ermon, Jiaming SongNeurIPS 2022 · 被引用 1,439 次
- Towards Robust Blind Face Restoration with Codebook Lookup TransformerShangchen Zhou, Kelvin C. K. Chan, Chongyi Li, Chen Change LoyNeurIPS 2022 · 被引用 431 次
- Diffusion Posterior Sampling for General Noisy Inverse ProblemsHyungjin Chung, Jeongsol Kim, Michael Thompson McCann, Marc Louis Klasky 等ICLR 2023 · 被引用 152 次
相关 Paper
- 3D Priors-Guided Diffusion for Blind Face RestorationXiaobin Lu, Xiaobin Hu, Jun Luo, Ben Zhu 等ACM MM 2024 · 被引用 8 次
- AuthFace: Towards Authentic Blind Face Restoration with Face-oriented Generative Diffusion PriorGuoqiang Liang, Qingnan Fan, Bingtao Fu, Jinwei Chen 等ACM MM 2025 · 被引用 3 次
- LD-BFR: Vector-Quantization-Based Face Restoration Model with Latent Diffusion EnhancementYuzhen Du, Teng Hu, Ran Yi, Lizhuang MaACM MM 2024 · 被引用 3 次
- Learning Degradation-Unaware Representation with Prior-Based Latent Transformations for Blind Face RestorationLianxin Xie, Bingbing Zheng, Wen Xue, Le Jiang 等CVPR 2024 · 被引用 6 次
- FaceMe: Robust Blind Face Restoration with Personal IdentificationSiyu Liu, Zheng-Peng Duan, Jia Ouyang, Jiayi Fu 等AAAI 2025 · 被引用 18 次
