SUMI-IFL: An Information-Theoretic Framework for Image Forgery Localization with Sufficiency and Minimality Constraints
Ziqi Sheng, Wei Lu, Xiangyang Luo, Jiantao Zhou, Xiaochun Cao
Abstract
Image forgery localization (IFL) is a crucial technique for preventing tampered image misuse and protecting social safety. However, due to the rapid development of image tampering technologies, extracting more comprehensive and accurate forgery clues remains an urgent challenge. To address these challenges, we introduce a novel information-theoretic IFL framework named SUMI-IFL that imposes sufficiencyview and minimality-view constraints on forgery feature representation. First, grounded in the theoretical analysis of mutual information, the sufficiency-view constraint is enforced on the feature extraction network to ensure that the latent forgery feature contains comprehensive forgery clues. Considering that forgery clues obtained from a single aspect alone may be incomplete, we construct the latent forgery feature by integrating several individual forgery features from multiple perspectives. Second, based on the information bottleneck, the minimality-view constraint is imposed on the feature reasoning network to achieve an accurate and concise forgery feature representation that counters the interference of taskunrelated features. Extensive experiments show the superior performance of SUMI-IFL to existing state-of-the-art methods, not only on in-dataset comparisons but also on crossdataset comparisons.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4e7aa796-3d5b-4df1-bdf2-c9151cae9a7cCited by top-tier papers2
- Weakly-Supervised Image Forgery Localization via Vision-Language Collaborative Reasoning FrameworkZiqi Sheng, Junyan Wu, Wei Lu, Jiantao ZhouAAAI 2026 · 3 citations
- A Multimodal Deviation Perceiving Framework for Weakly-Supervised Temporal Forgery LocalizationWenbo Xu, Junyan Wu, Wei Lu, Xiangyang Luo et al.ACM MM 2025 · 2 citations
Builds on12
- DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingFeng Li, Hao Zhang, Shilong Liu, Jian Guo et al.CVPR 2022 · 879 citations
- ObjectFormer for Image Manipulation Detection and LocalizationJunke Wang, Zuxuan Wu, Jingjing Chen, Xintong Han et al.CVPR 2022 · 190 citations
- Exposing the Deception: Uncovering More Forgery Clues for Deepfake DetectionZhongjie Ba, Qingyu Liu, Zhenguang Liu, Shuang Wu et al.AAAI 2024 · 101 citations
- A Novel Approach for Effective Multi-View Clustering with Information-Theoretic PerspectiveChenhang Cui, Yazhou Ren, Jingyu Pu, Jiawei Li et al.NeurIPS 2023 · 67 citations
- Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency LearningYuanhao Zhai, Tianyu Luan, David S. Doermann, Junsong YuanICCV 2023 · 35 citations
Related papers
- M²RL-Net: Multi-View and Multi-Level Relation Learning Network for Weakly-Supervised Image Forgery DetectionJiafeng Li, Ying Wen, Lianghua HeAAAI 2025 · 2 citations
- DiffForensics: Leveraging Diffusion Prior to Image Forgery Detection and LocalizationZeqin Yu, Jiangqun Ni, Yuzhen Lin, Haoyi Deng et al.CVPR 2024 · 25 citations
- Information Bottleneck Disentanglement for Identity SwappingGege Gao, Huaibo Huang, Chaoyou Fu, Zhaoyang Li et al.CVPR 2021
- Hierarchical Fine-Grained Image Forgery Detection and LocalizationXiao Guo, Xiaohong Liu, Zhiyuan Ren, Steven Grosz et al.CVPR 2023
- UnionFormer: Unified-Learning Transformer with Multi-View Representation for Image Manipulation Detection and LocalizationShuaibo Li, Wei Ma, Jianwei Guo, Shibiao Xu et al.CVPR 2024
