Knowledge-Enhanced Multimodal Fake News Detection: Semantic Visual and Priority Fusion
Qin Zhang, Jiaying Liu, Qian Tao, Zhiwei Guo, Qiyue Zhong, Yifan Zhang, Ziyan Huang
Abstract
Multimodal fake information increasingly threatens the Web ecosystem's trustworthiness and security, making improving detection accuracy a critical scientific challenge. The limited information interaction in traditional multimodal fake news detection methods fails to leverage semantic knowledge to model complex cross-modal forgery patterns and global structural anomalies, restricting the model's capability. To address the issues, this paper proposes a multimodal fake news detection method, SVPF-Net, that centers on semantic-driven visual enhancement and knowledge-aided modality-priority fusion. For visual representation optimization, we design a dual-feature extraction module and a dual-fusion enhancement module. A weighted fusion strategy is employed to construct a structured visual representation that integrates the semantics of local forgeries and global anomalies. Meanwhile, a cross-attention mechanism enables bidirectional alignment and interactive coupling between local and global image features, thereby achieving effective complementarity between local forgery cues and global anomaly patterns. For multimodal fusion, high-quality textual semantic features and visual representations are integrated via a modality-priority progressive fusion strategy that relies on cross-attention. The integration enables robust cross-modal semantic interaction and effectively enhances the efficiency of multimodal feature fusion. Comprehensive experiments validate the optimal performance of SVPF-Net and its ability to enhance interpretable semantics, providing valuable support for the practical application of reliable fake news detection.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 9fcc4028-6be6-4c97-9d39-837e7f10305aRelated papers
- Hierarchical Semantic Enhancement Network for Multimodal Fake News DetectionQiang Zhang, Jiawei Liu, Fanrui Zhang, Jingyi Xie et al.ACM MM 2023 · 10 citations
- Reinforced Adaptive Knowledge Learning for Multimodal Fake News DetectionLitian Zhang, Xiaoming Zhang, Ziyi Zhou, Feiran Huang et al.AAAI 2024 · 54 citations
- Cross-modal Contrastive Learning for Multimodal Fake News DetectionLongzheng Wang, Chuang Zhang, Hongbo Xu, Yongxiu Xu et al.ACM MM 2023 · 100 citations
- Bootstrapping Multi-View Representations for Fake News DetectionQichao Ying, Xiaoxiao Hu, Yangming Zhou, Zhenxing Qian et al.AAAI 2023 · 111 citations
- Hierarchical Multi-modal Contextual Attention Network for Fake News DetectionShengsheng Qian, Jinguang Wang, Jun Hu, Quan Fang et al.SIGIR 2021 · 273 citations
