Dynamic Graph Learning with Content-guided Spatial-Frequency Relation Reasoning for Deepfake Detection
Yuan Wang, Kun Yu, Chen Chen, Xiyuan Hu, Silong Peng
Abstract
With the springing up of face synthesis techniques, it is prominent in need to develop powerful face forgery detection methods due to security concerns. Some existing methods attempt to employ auxiliary frequency-aware information combined with CNN backbones to discover the forged clues. Due to the inadequate information interaction with image content, the extracted frequency features are thus spatially irrelavant, struggling to generalize well on increasingly realistic counterfeit types. To address this issue, we propose a Spatial-Frequency Dynamic Graph method to exploit the relation-aware features in spatial and frequency domains via dynamic graph learning. To this end, we introduce three well-designed components: 1) Content-guided Adaptive Frequency Extraction module to mine the content-adaptive forged frequency clues. 2) Multiple Domains Attention Map Learning module to enrich the spatial-frequency contextual features with multiscale attention maps. 3) Dynamic Graph Spatial-Frequency Feature Fusion Network to explore the high-order relation of spatial and frequency features. Extensive experiments on several benchmark show that our proposed method sustainedly exceeds the state-of-the-arts by a considerable margin.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2c83137a-d441-4848-9f8d-0ebf8cb5262bCited by top-tier papers30
- UCF: Uncovering Common Features for Generalizable Deepfake DetectionZhiyuan Yan, Yong Zhang, Yanbo Fan, Baoyuan WuICCV 2023 · 264 citations
- Frequency-Aware Deepfake Detection: Improving Generalizability through Frequency Space Domain LearningChuangchuang Tan, Yao Zhao, Shikui Wei, Guanghua Gu et al.AAAI 2024 · 232 citations
- FreqBlender: Enhancing DeepFake Detection by Blending Frequency KnowledgeHanzhe Li, Jiaran Zhou, Yuezun Li, Baoyuan Wu et al.NeurIPS 2024 · 96 citations
- Federated Graph Learning under Domain Shift with Generalizable PrototypesGuancheng Wan, Wenke Huang, Mang YeAAAI 2024 · 70 citations
- DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable DiffusionKe Sun, Shen Chen, Taiping Yao, Hong Liu et al.NeurIPS 2024 · 57 citations
Builds on23
- MLP-Mixer: An all-MLP Architecture for VisionIlya O. Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer et al.NeurIPS 2021 · 3,862 citations
- FaceForensics++: Learning to Detect Manipulated Facial ImagesAndreas Rössler, Davide Cozzolino, Luisa Verdoliva, Christian Riess et al.ICCV 2019 · 2,966 citations
- Vision GNN: An Image is Worth Graph of NodesKai Han, Yunhe Wang, Jianyuan Guo, Yehui Tang et al.NeurIPS 2022 · 668 citations
- Visual Semantic Reasoning for Image-Text MatchingKunpeng Li, Yulun Zhang, Kai Li, Yuanyuan Li et al.ICCV 2019 · 598 citations
- WildDeepfake: A Challenging Real-World Dataset for Deepfake DetectionBojia Zi, Minghao Chang, Jingjing Chen, Xingjun Ma et al.ACM MM 2020 · 443 citations
Related papers
- Local Relation Learning for Face Forgery DetectionShen Chen, Taiping Yao, Yang Chen, Shouhong Ding et al.AAAI 2021 · 340 citations
- Generalizing Face Forgery Detection With High-Frequency FeaturesYuchen Luo, Yong Zhang, Junchi Yan, Wei LiuCVPR 2021
- Exploiting Fine-Grained Face Forgery Clues via Progressive Enhancement LearningQiqi Gu, Shen Chen, Taiping Yao, Yang Chen et al.AAAI 2022 · 187 citations
- Controllable Guide-Space for Generalizable Face Forgery DetectionYing Guo, Cheng Zhen, Pengfei YanICCV 2023 · 35 citations
- Critical Forgetting-Based Multi-Scale Disentanglement for Deepfake DetectionKai Li, Wenqi Ren, Jianshu Li, Wei Wang et al.AAAI 2025 · 3 citations
