Lune

ICCV2023Top-tier venue

BlendFace: Re-designing Identity Encoders for Face-Swapping

Kaede Shiohara, Xingchao Yang, Takafumi Taketomi

2023Year
83Citations
23Top-tier citations

Abstract

The great advancements of generative adversarial networks and face recognition models in computer vision have made it possible to swap identities on images from single sources. Although a lot of studies seems to have proposed almost satisfactory solutions, we notice previous methods still suffer from an identity-attribute entanglement that causes undesired attributes swapping because widely used identity encoders, e.g., ArcFace, have some crucial attribute biases owing to their pretraining on face recognition tasks. To address this issue, we design Blend-Face, a novel identity encoder for face-swapping. The key idea behind BlendFace is training face recognition models on blended images whose attributes are replaced with those of another mitigates inter-personal biases such as hairsyles. BlendFace feeds disentangled identity features into generators and guides generators properly as an identity loss function. Extensive experiments demonstrate that BlendFace improves the identity-attribute disentanglement in face-swapping models, maintaining a comparable quantitative performance to previous methods. The code and models are available at https://github.com/ mapooon/BlendFace .

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

Questions to start from

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

lune papers fulltext d9ae4fe3-7c56-4479-94b1-52aa4b10e1ce

Cited by top-tier papers23

Ask how each one uses it

Builds on32

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines