Optimizing ID Consistency in Multimodal Large Models: Facial Restoration via Alignment, Entanglement, and Disentanglement
Yuran Dong, Hang Dai, Mang Ye
摘要
Multimodal editing large models have demonstrated powerful editing capabilities across diverse tasks. However, a persistent and long-standing limitation is the decline in facial identity (ID) consistency during realistic portrait editing. Due to the human eye’s high sensitivity to facial features, such inconsistency significantly hinders the practical deployment of these models. Current facial ID preservation methods struggle to achieve consistent restoration of both facial identity and edited element IP due to Cross-source Distribution Bias and Cross-source Feature Contamination. To address these issues, we propose EditedID, an Alignment-Disentanglement-Entanglement framework for robust identity-specific facial restoration. By systematically analyzing diffusion trajectories, sampler behaviors, and attention properties, we introduce three key components: 1) Adaptive mixing strategy that aligns cross-source latent representations throughout the diffusion process. 2) Hybrid solver that disentangles source-specific identity attributes and details. 3) Attentional gating mechanism that selectively entangles visual elements. Extensive experiments show that EditedID achieves state-of-the-art performance in preserving original facial ID and edited element IP consistency. As a training-free and plug-and-play solution, it establishes a new benchmark for practical and reliable single/multi-person facial identity restoration in open-world settings, paving the way for the deployment of multimodal editing large models in real-person editing scenarios. The code is available at https://github.com/NDYBSNDY/EditedID.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper16
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- ImageReward: Learning and Evaluating Human Preferences for Text-to-Image GenerationJiazheng Xu, Xiao Liu, Yuchen Wu, Yuxuan Tong 等NeurIPS 2023 · 被引用 1,310 次
- CLIPScore: A Reference-free Evaluation Metric for Image CaptioningJack Hessel, Ari Holtzman, Maxwell Forbes, Ronan Le Bras 等EMNLP 2021 · 被引用 937 次
- Blended Diffusion for Text-driven Editing of Natural ImagesOmri Avrahami, Dani Lischinski, Ohad FriedCVPR 2022 · 被引用 670 次
相关 Paper
- OmniPortrait: Fine-Grained Personalized Portrait Synthesis via Pivotal OptimizationDongxu Yue, Bo Lin, Yao Tang, Jiajun Liang 等ICLR 2026
- VividFace: A Robost and High-Fidelity Video Face Swapping FrameworkHao Shao, Shulun Wang, Yang Zhou, Guanglu Song 等NeurIPS 2025 · 被引用 4 次
- UniPortrait: A Unified Framework for Identity-Preserving Single- and Multi-Human Image PersonalizationJunjie He, Yifeng Geng, Liefeng BoICCV 2025 · 被引用 2 次
- Face2Diffusion for Fast and Editable Face PersonalizationKaede Shiohara, Toshihiko YamasakiCVPR 2024 · 被引用 13 次
- Foundation Cures Personalization: Improving Personalized Models' Prompt Consistency via Hidden Foundation KnowledgeYiyang Cai, Zhengkai Jiang, Yulong Liu, Chunyang Jiang 等NeurIPS 2025 · 被引用 2 次
