InstantRestore: Single-Step Personalized Face Restoration with Shared-Image Attention
Howard Zhang, Yuval Alaluf, Sizhuo Ma, Achuta Kadambi, Jian Wang, Kfir Aberman
摘要
Face image restoration aims to enhance degraded facial images while addressing challenges such as diverse degradation types, real-time processing demands, and, most crucially, the preservation of identity-specific features. Existing methods often struggle with slow processing times and suboptimal restoration, especially under severe degradation, failing to accurately reconstruct finer-level identity details. To address these issues, we introduce InstantRestore, a novel framework that leverages a single-step image diffusion model and an attention-sharing mechanism for fast and personalized face restoration. Additionally, InstantRestore incorporates a novel landmark attention loss, aligning key facial landmarks to refine the attention maps, enhancing identity preservation. At inference time, given a degraded input and a small (∼ 4) set of reference images, InstantRestore performs a single forward pass through the network to achieve near real-time performance. Unlike prior approaches that rely on full diffusion processes or per-identity model tuning, InstantRestore offers a scalable solution suitable for large-scale applications. Extensive experiments demonstrate that InstantRestore outperforms existing methods in quality and speed, making it an appealing choice for identity-preserving face restoration.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper5
- Trust but Verify: Adaptive Conditioning for Reference-Based Diffusion Super-Resolution via Implicit Reference Correlation ModelingYuan Wang, Yuhao Wan, Siming Zheng, Bo Li 等ICLR 2026 · 被引用 7 次
- RenderFlow: Single-Step Neural Rendering via Flow MatchingShenghao Zhang, Runtao Liu, Christopher Schroers, Yang ZhangCVPR 2026 · 被引用 3 次
- RefSTAR: Blind Face Image Restoration with Reference Selection, Transfer, and ReconstructionZhicun Yin, Junjie Chen, Ming Liu, Zhixin Wang 等AAAI 2026 · 被引用 2 次
- MR. Illuminate: Zero-Shot Low-Light Image Enhancement with Diffusion PriorJoshua Cho, Sara Aghajanzadeh, Zhen Zhu, David ForsythCVPR 2026
- Face2Scene: Using Facial Degradation as an Oracle for Diffusion-Based Scene RestorationAmirhossein Kazerouni, Maitreya Suin, Tristan T Aumentado-Armstrong, Sina Honari 等CVPR 2026
它引用的顶会 Paper42
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 被引用 5,568 次
- GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion ModelsAlexander Quinn Nichol, Prafulla Dhariwal, Aditya Ramesh, Pranav Shyam 等ICML 2022 · 被引用 4,691 次
- Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 被引用 3,959 次
相关 Paper
- InstantPortrait: One-Step Portrait Editing via Diffusion Multi-Objective DistillationZhixin Lai, Keqiang Sun, Fu-Yun Wang, Dhritiman Sagar 等ICLR 2025
- FaceMe: Robust Blind Face Restoration with Personal IdentificationSiyu Liu, Zheng-Peng Duan, Jia Ouyang, Jiayi Fu 等AAAI 2025 · 被引用 18 次
- WaveFace: Authentic Face Restoration with Efficient Frequency RecoveryYunqi Miao, Jiankang Deng, Jungong HanCVPR 2024 · 被引用 6 次
- Show and Polish: Reference-Guided Identity Preservation in Face Video RestorationWenkang Han, Wang Lin, Yiyun Zhou, Qi Liu 等ACM MM 2025 · 被引用 1 次
- LD-BFR: Vector-Quantization-Based Face Restoration Model with Latent Diffusion EnhancementYuzhen Du, Teng Hu, Ran Yi, Lizhuang MaACM MM 2024 · 被引用 3 次
