Face2Scene: Using Facial Degradation as an Oracle for Diffusion-Based Scene Restoration
Amirhossein Kazerouni, Maitreya Suin, Tristan T Aumentado-Armstrong, Sina Honari, Amanpreet Walia, Iqbal Mohomed, Kosta Derpanis, Babak TAATI, Alex Levinshtein
摘要
Recent advances in image restoration have enabled high-fidelity recovery of faces from degraded inputs using reference-based face restoration models (Ref-FR). However, such methods focus solely on facial regions, neglecting degradation across the full scene, including body and background, which limits practical usability. Meanwhile, full-scene restorers often ignore degradation cues entirely, leading to underdetermined predictions and visual artifacts. In this work, we propose Face2Scene , a two-stage restoration framework that leverages the face as a perceptual oracle to estimate degradation and guide the restoration of the entire image. Given a degraded image and one or more identity references, we first apply a Ref-FR model to reconstruct high-quality facial details. From the restored–degraded face pair, we extract a face-derived degradation code that captures degradation attributes (e.g., noise, blur, compression), which is then transformed into multi-scale degradation-aware tokens. These tokens condition a diffusion model to restore the full scene in a single step, including the body and background. Extensive experiments demonstrate the superior effectiveness of the proposed method compared to state-of-the-art methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper29
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou 等ICCV 2021 · 被引用 8,921 次
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 被引用 6,759 次
相关 Paper
- FaceMe: Robust Blind Face Restoration with Personal IdentificationSiyu Liu, Zheng-Peng Duan, Jia Ouyang, Jiayi Fu 等AAAI 2025 · 被引用 18 次
- LD-BFR: Vector-Quantization-Based Face Restoration Model with Latent Diffusion EnhancementYuzhen Du, Teng Hu, Ran Yi, Lizhuang MaACM MM 2024 · 被引用 3 次
- AuthFace: Towards Authentic Blind Face Restoration with Face-oriented Generative Diffusion PriorGuoqiang Liang, Qingnan Fan, Bingtao Fu, Jinwei Chen 等ACM MM 2025 · 被引用 3 次
- TPGDiff : Hierarchical Triple-Prior Guided Diffusion for Image RestorationYanjie Tu, Qingsen Yan, Axi Niu, Jiacong TangICML 2026 · 被引用 2 次
- Restoration by Generation with Constrained PriorsZheng Ding, Xuaner Zhang, Zhuowen Tu, Zhihao XiaCVPR 2024
