SimSwap: An Efficient Framework For High Fidelity Face Swapping
Renwang Chen, Xuanhong Chen, Bingbing Ni, Yanhao Ge
Abstract
We propose an efficient framework, called Simple Swap (SimSwap), aiming for generalized and high fidelity face swapping. In contrast to previous approaches that either lack the ability to generalize to arbitrary identity or fail to preserve attributes like facial expression and gaze direction, our framework is capable of transferring the identity of an arbitrary source face into an arbitrary target face while preserving the attributes of the target face. We overcome the above defects in the following two ways. First, we present the ID Injection Module (IIM) which transfers the identity information of the source face into the target face at feature level. By using this module, we extend the architecture of an identity-specific face swapping algorithm to a framework for arbitrary face swapping. Second, we propose the Weak Feature Matching Loss which efficiently helps our framework to preserve the facial attributes in an implicit way. Extensive experiments on wild faces demonstrate that our SimSwap is able to achieve competitive identity performance while preserving attributes better than previous state-of-the-art methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c1783d6e-6eb9-4cf0-8b85-845e9d06a53bCited by top-tier papers75
- OST: Improving Generalization of DeepFake Detection via One-Shot Test-Time TrainingLiang Chen, Yong Zhang, Yibing Song, Jue Wang et al.NeurIPS 2022 · 102 citations
- High-resolution Face Swapping via Latent Semantics DisentanglementYangyang Xu, Bailin Deng, Junle Wang, Yanqing Jing et al.CVPR 2022 · 93 citations
- BlendFace: Re-designing Identity Encoders for Face-SwappingKaede Shiohara, Xingchao Yang, Takafumi TaketomiICCV 2023 · 83 citations
- MobileFaceSwap: A Lightweight Framework for Video Face SwappingZhiliang Xu, Zhibin Hong, Changxing Ding, Zhen Zhu et al.AAAI 2022 · 78 citations
- SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake DetectionXiaoshuai Wu, Xin Liao, Bo OuACM MM 2023 · 74 citations
Builds on4
- FaceForensics++: Learning to Detect Manipulated Facial ImagesAndreas Rössler, Davide Cozzolino, Luisa Verdoliva, Christian Riess et al.ICCV 2019 · 2,966 citations
- FSGAN: Subject Agnostic Face Swapping and ReenactmentYuval Nirkin, Yosi Keller, Tal HassnerICCV 2019 · 710 citations
- Few-Shot Unsupervised Image-to-Image TranslationMing-Yu Liu, Xun Huang, Arun Mallya, Tero Karras et al.ICCV 2019 · 668 citations
- MaskGAN: Towards Diverse and Interactive Facial Image ManipulationCheng-Han Lee, Ziwei Liu, Lingyun Wu, Ping LuoCVPR 2020
Related papers
- High Fidelity Face Swapping via Semantics Disentanglement and Structure EnhancementFengyuan Liu, Lingyun Yu, Hongtao Xie, Chuanbin Liu et al.ACM MM 2023 · 1 citation
- High-Fidelity Diffusion Face Swapping with ID-Constrained Facial ConditioningDailan He, Xiahong Wang, Shulun Wang, Hao Shao et al.CVPR 2026 · 5 citations
- FaceController: Controllable Attribute Editing for Face in the WildZhiliang Xu, Xiyu Yu, Zhibin Hong, Zhen Zhu et al.AAAI 2021 · 49 citations
- FlowFace: Semantic Flow-Guided Shape-Aware Face SwappingHao Zeng, Wei Zhang, Changjie Fan, Tangjie Lv et al.AAAI 2023 · 11 citations
- Smooth-Swap: A Simple Enhancement for Face-Swapping with SmoothnessJiseob Kim, Jihoon Lee, Byoung-Tak ZhangCVPR 2022
