Attribute-Preserving Face Dataset Anonymization via Latent Code Optimization
Simone Barattin, Christos Tzelepis, Ioannis Patras, Nicu Sebe
Abstract
This work addresses the problem of anonymizing the identity of faces in a dataset of images, such that the privacy of those depicted is not violated, while at the same time the dataset is useful for downstream task such as for training machine learning models. To the best of our knowledge, we are the first to explicitly address this issue and deal with two major drawbacks of the existing state-of-the-art approaches, namely that they (i) require the costly training of additional, purpose-trained neural networks, and/or (ii) fail to retain the facial attributes of the original images in the anonymized counterparts, the preservation of which is of paramount importance for their use in downstream tasks. We accordingly present a task-agnostic anonymization procedure that directly optimizes the images' latent representation in the latent space of a pre-trained GAN. By optimizing the latent codes directly, we ensure both that the identity is of a desired distance away from the original (with an identity obfuscation loss), whilst preserving the facial attributes (using a novel feature-matching loss in FaRL's [48] deep feature space). We demonstrate through a series of both qualitative and quantitative experiments that our method is capable of anonymizing the identity of the images whilstcrucially-better-preserving the facial attributes. We make the code and the pre-trained models publicly available at: https://github.com/chi0tzp/FALCO.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8887d4ee-e735-4050-b560-c683a74a4f85Cited by top-tier papers12
- HyperReenact: One-Shot Reenactment via Jointly Learning to Refine and Retarget FacesStella Bounareli, Christos Tzelepis, Vasileios Argyriou, Ioannis Patras et al.ICCV 2023 · 63 citations
- Adv-Diffusion: Imperceptible Adversarial Face Identity Attack via Latent Diffusion ModelDecheng Liu, Xijun Wang, Chunlei Peng, Nannan Wang et al.AAAI 2024 · 39 citations
- Disguise without Disruption: Utility-Preserving Face De-identificationZikui Cai, Zhongpai Gao, Benjamin Planche, Meng Zheng et al.AAAI 2024 · 28 citations
- Privacy-Preserving Optics for Enhancing Protection in Face De-IdentificationJhon Lopez, Carlos Hinojosa, Henry Arguello, Bernard GhanemCVPR 2024 · 9 citations
- PerceptAnon: Exploring the Human Perception of Image Anonymization Beyond Pseudonymization for GDPRKartik Patwari, Chen-Nee Chuah, Lingjuan Lyu, Vivek SharmaICML 2024 · 3 citations
Builds on10
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Talk-to-Edit: Fine-Grained Facial Editing via DialogYuming Jiang, Ziqi Huang, Xingang Pan, Chen Change Loy et al.ICCV 2021 · 162 citations
- General Facial Representation Learning in a Visual-Linguistic MannerYinglin Zheng, Hao Yang, Ting Zhang, Jianmin Bao et al.CVPR 2022 · 161 citations
- WarpedGANSpace: Finding non-linear RBF paths in GAN latent spaceChristos Tzelepis, Georgios Tzimiropoulos, Ioannis PatrasICCV 2021 · 66 citations
- PandA: Unsupervised Learning of Parts and Appearances in the Feature Maps of GANsJames Oldfield, Christos Tzelepis, Yannis Panagakis, Mihalis Nicolaou et al.ICLR 2023 · 10 citations
Related papers
- Effective De-identification Generative Adversarial Network for Face AnonymizationZhenzhong Kuang, Huigui Liu, Jun Yu, Aikui Tian et al.ACM MM 2021 · 43 citations
- A3GAN: Attribute-Aware Anonymization Networks for Face De-identificationLiming Zhai, Qing Guo, Xiaofei Xie, Lei Ma et al.ACM MM 2022 · 37 citations
- Utility-Preserving Face Anonymization via Differentially Private Feature OperationsChengqi Li, Sarah Simionescu, Wenbo He, Sanzheng Qiao et al.INFOCOM 2024
- Divide and Conquer: a Two-Step Method for High Quality Face De-identification with Model ExplainabilityYunqian Wen, Bo Liu, Jingyi Cao, Rong Xie et al.ICCV 2023
- FaceRSA: RSA-Aware Facial Identity Cryptography FrameworkZhongyi Zhang, Tianyi Wei, Wenbo Zhou, Hanqing Zhao et al.AAAI 2024 · 8 citations
