BiMind: A Dual-Head Reasoning Model with Attention-Geometry Adapter for Incorrect Information Detection
Zhongxing Zhang, Emily K. Vraga, Jisu Huh, Jaideep Srivastava
Abstract
Incorrect information poses significant challenges by disrupting content veracity and integrity, yet most detection approaches struggle to jointly balance textual content verification with external knowledge modification under collapsed attention geometries. To address this issue, we propose a dual-head reasoning framework, BiMind, which disentangles content-internal reasoning from knowledgeaugmented reasoning. In BiMind, we introduce three core innovations: (i) an attention geometry adapter that reshapes attention logits via token-conditioned offsets and mitigates attention collapse; (ii) a self-retrieval knowledge mechanism, which constructs an in-domain semantic memory through kNN retrieval and injects retrieved neighbors via feature-wise linear modulation; (iii) the uncertainty-aware fusion strategies, including entropy-gated fusion and a trainable agreement head, stabilized by a symmetric Kullback-Leibler agreement regularizer. To quantify the knowledge contributions, we define a novel metric, Value-of-eXperience (VoX), to measure instance-wise logit gains from knowledge-augmented reasoning. Experiment results on public datasets demonstrate that our BiMind model outperforms advanced detection approaches and provides interpretable diagnostics on when and why knowledge matters. Our BiMind model and the tested datasets are available at https://github.com/cvzh/BiMind .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on14
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- Deberta: decoding-Enhanced Bert with Disentangled AttentionPengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu ChenICLR 2021 · 3,729 citations
- Rumor Detection on Social Media with Bi-Directional Graph Convolutional NetworksTian Bian, Xi Xiao, Tingyang Xu, Peilin Zhao et al.AAAI 2020 · 773 citations
- KAN: Knowledge-aware Attention Network for Fake News DetectionYaqian Dun, Kefei Tu, Chen Chen, Chunyan Hou et al.AAAI 2021 · 142 citations
- Divide-and-Conquer: Post-User Interaction Network for Fake News Detection on Social MediaErxue Min, Yu Rong, Yatao Bian, Tingyang Xu et al.WWW 2022 · 82 citations
Related papers
- Knowledge-Augmented Language Model VerificationJinheon Baek, Soyeong Jeong, Minki Kang, Jong C. Park et al.EMNLP 2023 · 12 citations
- Bridging External and Parametric Knowledge: Mitigating Hallucination of LLMs with Shared-Private Semantic Synergy in Dual-Stream KnowledgeYi Sui, Chaozhuo Li, Chen Zhang, Dawei Song et al.EMNLP 2025 · 1 citation
- BiDeV: Bilateral Defusing Verification for Complex Claim Fact-CheckingYuxuan Liu, Hongda Sun, Wenya Guo, Xinyan Xiao et al.AAAI 2025 · 11 citations
- From Extraction to Deduction: Resolving Functional Misalignment in RAG via a Collaborative Critic-Reasoner FrameworkYufei Chen, Yao Wang, Haibin Zhang, Hualin zhou et al.ICML 2026
- Differential-Aware Synergy of Quantity and Topology for Hyper-Relational Knowledge Graphs with Numeric EntitiesMing Yin, Neng GaoKDD 2026
