Towards Open-world Generalized Deepfake Detection: General Feature Extraction via Unsupervised Domain Adaptation
Midou Guo, Qilin Yin, Wei Lu, Xiangyang Luo
Abstract
With the development of generative artificial intelligence, new forgery methods are rapidly emerging. Social platforms are flooded with vast amounts of unlabeled synthetic data and authentic data, making it increasingly challenging to distinguish real from fake. Due to the lack of labels, existing supervised detection methods struggle to effectively address the detection of unknown deepfake methods. Moreover, in open world scenarios, the amount of unlabeled data greatly exceeds that of labeled data. Therefore, we define a new deepfake detection generalization task which focuses on how to achieve efficient detection of large amounts of unlabeled data based on limited labeled data to simulate a open world scenario. To solve the above mentioned task, we propose a novel Open-World Deepfake Detection Generalization Enhancement Training Strategy (OWG-DS) to improve the generalization ability of existing methods. Our approach aims to transfer deepfake detection knowledge from a small amount of labeled source domain data to large-scale unlabeled target domain data. Specifically, we introduce the Domain Distance Optimization (DDO) module to align different domain features by optimizing both inter-domain and intra-domain distances. Additionally, the Similarity-based Class Boundary Separation (SCBS) module is used to enhance the aggregation of similar samples to ensure clearer class boundaries, while an adversarial training mechanism is adopted to learn the domain-invariant features. Extensive experiments show that the proposed deepfake detection generalization enhancement training strategy excels in cross-method and cross-dataset scenarios, improving the model's generalization.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3c3b23ea-a84f-42cf-a7d5-c2113d61d09cBuilds on16
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- FaceForensics++: Learning to Detect Manipulated Facial ImagesAndreas Rössler, Davide Cozzolino, Luisa Verdoliva, Christian Riess et al.ICCV 2019 · 2,966 citations
- DIRE for Diffusion-Generated Image DetectionZhendong Wang, Jianmin Bao, Wengang Zhou, Weilun Wang et al.ICCV 2023 · 479 citations
- Learning Self-Consistency for Deepfake DetectionTianchen Zhao, Xiang Xu, Mingze Xu, Hui Ding et al.ICCV 2021 · 368 citations
- Detecting Deepfakes with Self-Blended ImagesKaede Shiohara, Toshihiko YamasakiCVPR 2022 · 366 citations
Related papers
- Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake DetectionZhiyuan Yan, Yuhao Luo, Siwei Lyu, Qingshan Liu et al.CVPR 2024
- Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake DetectionLiang Chen, Yong Zhang, Yibing Song, Lingqiao Liu et al.CVPR 2022 · 251 citations
- A Sanity Check for Multi-In-Domain Face Forgery Detection in the Real WorldJikang Cheng, Renye Yan, Zhiyuan Yan, Yaozhong Gan et al.CVPR 2026 · 1 citation
- Advancing Generalized Deepfake Detector with Forgery Perception GuidanceRuiyang Xia, Dawei Zhou, Decheng Liu, Lin Yuan et al.ACM MM 2024 · 10 citations
- Contrastive Pseudo Learning for Open-World DeepFake AttributionZhimin Sun, Shen Chen, Taiping Yao, Bangjie Yin et al.ICCV 2023 · 42 citations
