Metric Learning for Anti-Compression Facial Forgery Detection
Shenhao Cao, Qin Zou, Xiuqing Mao, Dengpan Ye, Zhongyuan Wang
Abstract
Detecting facial forgery images and videos is an increasingly important topic in multimedia forensics. As forgery images and videos are usually compressed into different formats such as JPEG and H264 when circulating on the Internet, existing forgery-detection methods trained on uncompressed data often suffer from significant performance degradation in identifying them. To solve this problem, we propose a novel anti-compression facial forgery detection framework, which learns a compression-insensitive embedding feature space utilizing both original and compressed forgeries. Specifically, our approach consists of three ideas: (i) extracting compression-insensitive features from both uncompressed and compressed forgeries using an adversarial learning strategy; (ii) learning a robust partition by constructing a metric loss that can reduce the distance of the paired original and compressed images in the embedding space; (iii) improving the accuracy of tampered localization with an attention-transfer module. Experimental results demonstrate that, the proposed method is highly effective in handling both compressed and uncompressed facial forgery images.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7cff2442-24b3-4e7c-bc56-c59ee8a86871Cited by top-tier papers3
- End-to-End Reconstruction-Classification Learning for Face Forgery DetectionJunyi Cao, Chao Ma, Taiping Yao, Shen Chen et al.CVPR 2022 · 327 citations
- JPEG Compression-aware Image Forgery LocalizationMenglu Wang, Xueyang Fu, Jiawei Liu, Zheng-Jun ZhaACM MM 2022 · 22 citations
- Implicit Identity Driven Deepfake Face Swapping DetectionBaojin Huang, Zhongyuan Wang, Jifan Yang, Jiaxin Ai et al.CVPR 2023
Builds on10
- FaceForensics++: Learning to Detect Manipulated Facial ImagesAndreas Rössler, Davide Cozzolino, Luisa Verdoliva, Christian Riess et al.ICCV 2019 · 2,966 citations
- Few-Shot Adversarial Learning of Realistic Neural Talking Head ModelsEgor Zakharov, Aliaksandra Shysheya, Egor Burkov, Victor S. LempitskyICCV 2019 · 687 citations
- Face X-Ray for More General Face Forgery DetectionLingzhi Li, Jianmin Bao, Ting Zhang, Hao Yang et al.CVPR 2020
- CNN-Generated Images Are Surprisingly Easy to Spot... for NowSheng-Yu Wang, Oliver Wang, Richard Zhang, Andrew Owens et al.CVPR 2020
- On the Detection of Digital Face ManipulationHao Dang, Feng Liu, Joel Stehouwer, Xiaoming Liu et al.CVPR 2020
Related papers
- Self-supervised Domain Adaptation for Forgery Localization of JPEG Compressed ImagesYuan Rao, Jiangqun NiICCV 2021 · 34 citations
- Lips Don't Lie: A Generalisable and Robust Approach To Face Forgery DetectionAlexandros Haliassos, Konstantinos Vougioukas, Stavros Petridis, Maja PanticCVPR 2021
- Critical Forgetting-Based Multi-Scale Disentanglement for Deepfake DetectionKai Li, Wenqi Ren, Jianshu Li, Wei Wang et al.AAAI 2025 · 3 citations
- Leveraging Real Talking Faces via Self-Supervision for Robust Forgery DetectionAlexandros Haliassos, Rodrigo Mira, Stavros Petridis, Maja PanticCVPR 2022 · 138 citations
- Self-Supervised Image Local Forgery Detection by JPEG Compression TraceXiuli Bi, Wuqing Yan, Bo Liu, Bin Xiao et al.AAAI 2023 · 10 citations
