Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalization
Shichao Dong, Jin Wang, Renhe Ji, Jiajun Liang, Haoqiang Fan, Zheng Ge
摘要
In this paper, we analyse the generalization ability of binary classifiers for the task of deepfake detection. We find that the stumbling block to their generalization is caused by the unexpected learned identity representation on images. Termed as the Implicit Identity Leakage, this phenomenon has been qualitatively and quantitatively verified among various DNNs. Furthermore, based on such understanding, we propose a simple yet effective method named the IDunaware Deepfake Detection Model to reduce the influence of this phenomenon. Extensive experimental results demonstrate that our method outperforms the state-of-the-art in both in-dataset and cross-dataset evaluation. The code is available at https://github.com/megvii-research/CADDM.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper45
- UCF: Uncovering Common Features for Generalizable Deepfake DetectionZhiyuan Yan, Yong Zhang, Yanbo Fan, Baoyuan WuICCV 2023 · 被引用 264 次
- DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable DiffusionKe Sun, Shen Chen, Taiping Yao, Hong Liu 等NeurIPS 2024 · 被引用 57 次
- Locate and Verify: A Two-Stream Network for Improved Deepfake DetectionChao Shuai, Jieming Zhong, Shuang Wu, Feng Lin 等ACM MM 2023 · 被引用 52 次
- AVFF: Audio-Visual Feature Fusion for Video Deepfake DetectionTrevine Oorloff, Surya Koppisetti, Nicolò Bonettini, Divyaraj Solanki 等CVPR 2024 · 被引用 51 次
- LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake DetectionDat Nguyen, Nesryne Mejri, Inder Pal Singh, Polina Kuleshova 等CVPR 2024 · 被引用 47 次
它引用的顶会 Paper22
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- FaceForensics++: Learning to Detect Manipulated Facial ImagesAndreas Rössler, Davide Cozzolino, Luisa Verdoliva, Christian Riess 等ICCV 2019 · 被引用 2,966 次
- Scale-Aware Trident Networks for Object DetectionYanghao Li, Yuntao Chen, Naiyan Wang, Zhaoxiang ZhangICCV 2019 · 被引用 1,031 次
- SimSwap: An Efficient Framework For High Fidelity Face SwappingRenwang Chen, Xuanhong Chen, Bingbing Ni, Yanhao GeACM MM 2020 · 被引用 409 次
- Learning Self-Consistency for Deepfake DetectionTianchen Zhao, Xiang Xu, Mingze Xu, Hui Ding 等ICCV 2021 · 被引用 368 次
相关 Paper
- FakeDiffer: Distributional Disparity Learning on Differentiated Reconstruction for Face Forgery DetectionBo Wang, Zhao Zhang, Suiyi Zhao, Xianming Ye 等AAAI 2025 · 被引用 4 次
- Frequency-Aware Deepfake Detection: Improving Generalizability through Frequency Space Domain LearningChuangchuang Tan, Yao Zhao, Shikui Wei, Guanghua Gu 等AAAI 2024 · 被引用 232 次
- Preserving Fairness Generalization in Deepfake DetectionLi Lin, Xinan He, Yan Ju, Xin Wang 等CVPR 2024
- FrePGAN: Robust Deepfake Detection Using Frequency-Level PerturbationsYonghyun Jeong, Doyeon Kim, Youngmin Ro, Jongwon ChoiAAAI 2022 · 被引用 159 次
- Protecting Celebrities from DeepFake with Identity Consistency TransformerXiaoyi Dong, Jianmin Bao, Dongdong Chen, Ting Zhang 等CVPR 2022 · 被引用 155 次
