Decision-Driven Orthogonal Learning with Complementary Feature Mining for Robust Synthetic Image Detection
Kai Li, Wei Wang, Linchao Zhang, Siying Zhu, Wenqi Ren
摘要
The widespread and inconsistent compression applied by Online Social Networks severely degrades the performance of synthetic image detectors. We attribute this degradation to two main issues: 1) the model confuses forgery artifacts with compression artifacts, and 2) compression erodes crucial discriminative high-frequency details. Existing methods suppress compression features during training but overlook the overlap between compression features and forgery-related features, leading to the unintended removal of forgery traces. To address artifact confusion, we introduce a Decision-Driven Orthogonal Constraint, which defines a classification decision axis pointing from the real class centroid to the forged class centroid. This constraint enforces compression artifacts to be orthogonal to the decision axis, mitigating their interference with forgery detection without entirely removing them, thus preventing the suppression of forgery-related features. To mitigate the erosion of high-frequency details, we propose to mine complementary forgery cues from both low-frequency information and compressed high-frequency components. A bidirectional update strategy and an adaptive global-local modulator are proposed to facilitate the utilization of forgery cues. Extensive experiments demonstrate that our method achieves state-of-the-art generalization performance in challenging open-world detection scenarios.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper22
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- FaceForensics++: Learning to Detect Manipulated Facial ImagesAndreas Rössler, Davide Cozzolino, Luisa Verdoliva, Christian Riess 等ICCV 2019 · 被引用 2,966 次
- Leveraging Frequency Analysis for Deep Fake Image RecognitionJoel Frank, Thorsten Eisenhofer, Lea Schönherr, Asja Fischer 等ICML 2020 · 被引用 848 次
- How Do Vision Transformers Work?Namuk Park, Songkuk KimICLR 2022 · 被引用 653 次
相关 Paper
- Metric Learning for Anti-Compression Facial Forgery DetectionShenhao Cao, Qin Zou, Xiuqing Mao, Dengpan Ye 等ACM MM 2021 · 被引用 23 次
- Towards Open-world Generalized Deepfake Detection: General Feature Extraction via Unsupervised Domain AdaptationMidou Guo, Qilin Yin, Wei Lu, Xiangyang LuoACM MM 2025 · 被引用 2 次
- ODDN: Addressing Unpaired Data Challenges in Open-World Deepfake Detection on Online Social NetworksRenshuai Tao, Manyi Le, Chuangchuang Tan, Huan Liu 等AAAI 2025 · 被引用 7 次
- End-to-End Reconstruction-Classification Learning for Face Forgery DetectionJunyi Cao, Chao Ma, Taiping Yao, Shen Chen 等CVPR 2022 · 被引用 327 次
- JPEG Compression-aware Image Forgery LocalizationMenglu Wang, Xueyang Fu, Jiawei Liu, Zheng-Jun ZhaACM MM 2022 · 被引用 22 次
