Knowledge-Enhanced Multimodal Fake News Detection: Semantic Visual and Priority Fusion
Qin Zhang, Jiaying Liu, Qian Tao, Zhiwei Guo, Qiyue Zhong, Yifan Zhang, Ziyan Huang
摘要
Multimodal fake information increasingly threatens the Web ecosystem's trustworthiness and security, making improving detection accuracy a critical scientific challenge. The limited information interaction in traditional multimodal fake news detection methods fails to leverage semantic knowledge to model complex cross-modal forgery patterns and global structural anomalies, restricting the model's capability. To address the issues, this paper proposes a multimodal fake news detection method, SVPF-Net, that centers on semantic-driven visual enhancement and knowledge-aided modality-priority fusion. For visual representation optimization, we design a dual-feature extraction module and a dual-fusion enhancement module. A weighted fusion strategy is employed to construct a structured visual representation that integrates the semantics of local forgeries and global anomalies. Meanwhile, a cross-attention mechanism enables bidirectional alignment and interactive coupling between local and global image features, thereby achieving effective complementarity between local forgery cues and global anomaly patterns. For multimodal fusion, high-quality textual semantic features and visual representations are integrated via a modality-priority progressive fusion strategy that relies on cross-attention. The integration enables robust cross-modal semantic interaction and effectively enhances the efficiency of multimodal feature fusion. Comprehensive experiments validate the optimal performance of SVPF-Net and its ability to enhance interpretable semantics, providing valuable support for the practical application of reliable fake news detection.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- Hierarchical Semantic Enhancement Network for Multimodal Fake News DetectionQiang Zhang, Jiawei Liu, Fanrui Zhang, Jingyi Xie 等ACM MM 2023 · 被引用 10 次
- Reinforced Adaptive Knowledge Learning for Multimodal Fake News DetectionLitian Zhang, Xiaoming Zhang, Ziyi Zhou, Feiran Huang 等AAAI 2024 · 被引用 54 次
- Cross-modal Contrastive Learning for Multimodal Fake News DetectionLongzheng Wang, Chuang Zhang, Hongbo Xu, Yongxiu Xu 等ACM MM 2023 · 被引用 100 次
- Bootstrapping Multi-View Representations for Fake News DetectionQichao Ying, Xiaoxiao Hu, Yangming Zhou, Zhenxing Qian 等AAAI 2023 · 被引用 111 次
- Hierarchical Multi-modal Contextual Attention Network for Fake News DetectionShengsheng Qian, Jinguang Wang, Jun Hu, Quan Fang 等SIGIR 2021 · 被引用 273 次
