Lune

ACL Findings2026

Covariance Matrix-Driven Image Channel Allocation for Multimodal Fake News Detection

Zongliang Han, Wenyu Guo, Guoqing Jin, Yang Liu, Yan Song, Dong Yu, Wang Min

Abstract

With the widespread proliferation of the Internet, the spread of fake news has accelerated significantly, evolving from single-text content to multimodal forms that include images and videos. The task of Multimodal Fake News Detection (MFND) takes both text and relevant images as input for fake news identification. However, issues such as image noise and inaccurate focus of visual features often lead to insufficient attention to critical information within images during multimodal fusion. To effectively address these challenges, we propose a covariance matrix-driven image channel allocation method. This method first expands the number of original channel maps, then evaluates the importance of image channels through the covariance matrix and assigns importance scores to the expanded channel maps, thereby redirecting the focus of visual features. Subsequently, we design a multimodal fusion strategy based on a multilayer Co-Attention mechanism to achieve dynamic fusion across modalities. Finally, a contrastive learning loss is introduced to enhance the alignment between textual and visual modalities. Extensive experiments demonstrate that our method achieves state-of-the-art performance on three public multimodal fake news detection benchmark datasets.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Bootstrapping Multi-View Representations for Fake News Detection cites Cross-modal Ambiguity Learning for Multimodal Fake News Detection
  • Bootstrapping Multi-View Representations for Fake News Detection cites Multimodal Fusion with Co-Attention Networks for Fake News Detection
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on17

  1. A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
  2. Multimodal Fusion with Co-Attention Networks for Fake News DetectionYang Wu, Pengwei Zhan, Yunjian Zhang, Liming Wang et al.ACL Findings 2021 · 343 citations
  3. Cross-modal Ambiguity Learning for Multimodal Fake News DetectionYixuan Chen, Dongsheng Li, Peng Zhang, Jie Sui et al.WWW 2022 · 325 citations
  4. Hierarchical Multi-modal Contextual Attention Network for Fake News DetectionShengsheng Qian, Jinguang Wang, Jun Hu, Quan Fang et al.SIGIR 2021 · 273 citations
  5. Bootstrapping Multi-View Representations for Fake News DetectionQichao Ying, Xiaoxiao Hu, Yangming Zhou, Zhenxing Qian et al.AAAI 2023 · 111 citations

Related papers

  1. Cross-modal Contrastive Learning for Multimodal Fake News DetectionLongzheng Wang, Chuang Zhang, Hongbo Xu, Yongxiu Xu et al.ACM MM 2023 · 100 citations
  2. Knowledge-Enhanced Multimodal Fake News Detection: Semantic Visual and Priority FusionQin Zhang, Jiaying Liu, Qian Tao, Zhiwei Guo et al.WWW 2026
  3. Mitigating World Biases: A Multimodal Multi-View Debiasing Framework for Fake News Video DetectionZhi Zeng, Minnan Luo, Xiangzheng Kong, Huan Liu et al.ACM MM 2024 · 43 citations
  4. Each Fake News Is Fake in Its Own Way: An Attribution Multi-Granularity Benchmark for Multimodal Fake News DetectionHao Guo, Zihan Ma, Zhi Zeng, Minnan Luo et al.AAAI 2025 · 7 citations
  5. External Reliable Information-enhanced Multimodal Contrastive Learning for Fake News DetectionBiwei Cao, Qihang Wu, Jiuxin Cao, Bo Liu et al.AAAI 2025 · 11 citations
Dusk over the sea between two cliffs drawn in fine vertical lines