BlendFace: Re-designing Identity Encoders for Face-Swapping
Kaede Shiohara, Xingchao Yang, Takafumi Taketomi
Abstract
The great advancements of generative adversarial networks and face recognition models in computer vision have made it possible to swap identities on images from single sources. Although a lot of studies seems to have proposed almost satisfactory solutions, we notice previous methods still suffer from an identity-attribute entanglement that causes undesired attributes swapping because widely used identity encoders, e.g., ArcFace, have some crucial attribute biases owing to their pretraining on face recognition tasks. To address this issue, we design Blend-Face, a novel identity encoder for face-swapping. The key idea behind BlendFace is training face recognition models on blended images whose attributes are replaced with those of another mitigates inter-personal biases such as hairsyles. BlendFace feeds disentangled identity features into generators and guides generators properly as an identity loss function. Extensive experiments demonstrate that BlendFace improves the identity-attribute disentanglement in face-swapping models, maintaining a comparable quantitative performance to previous methods. The code and models are available at https://github.com/ mapooon/BlendFace .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d9ae4fe3-7c56-4479-94b1-52aa4b10e1ceCited by top-tier papers23
- Can We Leave Deepfake Data Behind in Training Deepfake Detector?Jikang Cheng, Zhiyuan Yan, Ying Zhang, Yuhao Luo et al.NeurIPS 2024 · 85 citations
- EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture ModelingHaiyang Liu, Zihao Zhu, Giorgio Becherini, Yichen Peng et al.CVPR 2024 · 55 citations
- X2-DFD: A framework for explainable and extendable Deepfake DetectionYize Chen, Zhiyuan Yan, Guangliang Cheng, Kangran Zhao et al.NeurIPS 2025 · 43 citations
- Standing on the Shoulders of Giants: Reprogramming Visual-Language Model for General Deepfake DetectionKaiqing Lin, Yuzhen Lin, Weixiang Li, Taiping Yao et al.AAAI 2025 · 32 citations
- WMamba: Wavelet-based Mamba for Face Forgery DetectionSiran Peng, Tianshuo Zhang, Li Gao, Xiangyu Zhu et al.ACM MM 2025 · 17 citations
Builds on32
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- FaceForensics++: Learning to Detect Manipulated Facial ImagesAndreas Rössler, Davide Cozzolino, Luisa Verdoliva, Christian Riess et al.ICCV 2019 · 2,966 citations
- Alias-Free Generative Adversarial NetworksTero Karras, Miika Aittala, Samuli Laine, Erik Härkönen et al.NeurIPS 2021 · 2,126 citations
- FSGAN: Subject Agnostic Face Swapping and ReenactmentYuval Nirkin, Yosi Keller, Tal HassnerICCV 2019 · 710 citations
- Few-Shot Adversarial Learning of Realistic Neural Talking Head ModelsEgor Zakharov, Aliaksandra Shysheya, Egor Burkov, Victor S. LempitskyICCV 2019 · 687 citations
Related papers
- 3D-Aware Face SwappingYixuan Li, Chao Ma, Yichao Yan, Wenhan Zhu et al.CVPR 2023
- FaceController: Controllable Attribute Editing for Face in the WildZhiliang Xu, Xiyu Yu, Zhibin Hong, Zhen Zhu et al.AAAI 2021 · 49 citations
- Reinforced Disentanglement for Face Swapping without Skip ConnectionXiaohang Ren, Xingyu Chen, Pengfei Yao, Heung-Yeung Shum et al.ICCV 2023 · 15 citations
- Information Bottleneck Disentanglement for Identity SwappingGege Gao, Huaibo Huang, Chaoyou Fu, Zhaoyang Li et al.CVPR 2021
- High-resolution Face Swapping via Latent Semantics DisentanglementYangyang Xu, Bailin Deng, Junle Wang, Yanqing Jing et al.CVPR 2022 · 93 citations
