FaceController: Controllable Attribute Editing for Face in the Wild
Zhiliang Xu, Xiyu Yu, Zhibin Hong, Zhen Zhu, Junyu Han, Jingtuo Liu, Errui Ding, Xiang Bai
Abstract
Face attribute editing aims to generate faces with one or multiple desired face attributes manipulated while other details are preserved. Unlike prior works such as GAN inversion which has an expensive reverse mapping process, we propose a simple feed-forward network to generate high-fidelity manipulated faces. By simply employing some existing and easy-obtainable prior information, our method can control, transfer, and edit diverse attributes of faces in the wild. The proposed method can consequently be applied to various applications such as face swapping, face relighting, and makeup transfer. In our method, we decouple identity, expression, pose, and illumination by using 3D priors; separate texture and colors by using region-wise style codes. All the information is embedded into adversarial learning by our identity-style normalization module. Disentanglement losses are proposed to enhance the generator to extract information independently from each attribute. Comprehensive quantitative and qualitative evaluations have been conducted. In a single framework, our method achieves the best or competitive scores on a variety of face applications.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 42db3ba5-d1c2-4a2a-af62-34728d6bec49Cited by top-tier papers5
- MobileFaceSwap: A Lightweight Framework for Video Face SwappingZhiliang Xu, Zhibin Hong, Changxing Ding, Zhen Zhu et al.AAAI 2022 · 78 citations
- SDGAN: Disentangling Semantic Manipulation for Facial Attribute EditingWenmin Huang, Weiqi Luo, Jiwu Huang, Xiaochun CaoAAAI 2024 · 20 citations
- Few-Shot Head Swapping in the WildChangyong Shu, Hemao Wu, Hang Zhou, Jiaming Liu et al.CVPR 2022 · 18 citations
- DynamicFace: High-Quality and Consistent Face Swapping for Image and Video Using Composable 3D Facial PriorsRunqi Wang, Yang Chen, Sijie Xu, Tianyao He et al.ICCV 2025 · 7 citations
- UnGANable: Defending Against GAN-based Face ManipulationZheng Li, Ning Yu, Ahmed Salem, Michael Backes et al.USENIX Security 2023
Builds on15
- FaceForensics++: Learning to Detect Manipulated Facial ImagesAndreas Rössler, Davide Cozzolino, Luisa Verdoliva, Christian Riess et al.ICCV 2019 · 2,966 citations
- Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?Rameen Abdal, Yipeng Qin, Peter WonkaICCV 2019 · 1,195 citations
- FSGAN: Subject Agnostic Face Swapping and ReenactmentYuval Nirkin, Yosi Keller, Tal HassnerICCV 2019 · 710 citations
- MarioNETte: Few-Shot Face Reenactment Preserving Identity of Unseen TargetsSungjoo Ha, Martin Kersner, Beomsu Kim, Seokjun Seo et al.AAAI 2020 · 184 citations
- LADN: Local Adversarial Disentangling Network for Facial Makeup and De-MakeupQiao Gu, Guanzhi Wang, Mang Tik Chiu, Yu-Wing Tai et al.ICCV 2019 · 119 citations
Related papers
- A Latent Transformer for Disentangled Face Editing in Images and VideosXu Yao, Alasdair Newson, Yann Gousseau, Pierre HellierICCV 2021 · 97 citations
- Adaptive Nonlinear Latent Transformation for Conditional Face EditingZhizhong Huang, Siteng Ma, Junping Zhang, Hongming ShanICCV 2023 · 13 citations
- TransEditor: Transformer-Based Dual-Space GAN for Highly Controllable Facial EditingYanbo Xu, Yueqin Yin, Liming Jiang, Qianyi Wu et al.CVPR 2022 · 53 citations
- Controllable Person Image Synthesis With Attribute-Decomposed GANYifang Men, Yiming Mao, Yuning Jiang, Wei-Ying Ma et al.CVPR 2020
- MOST-GAN: 3D Morphable StyleGAN for Disentangled Face Image ManipulationSafa C. Medin, Bernhard Egger, Anoop Cherian, Ye Wang et al.AAAI 2022 · 38 citations
