BiMind: A Dual-Head Reasoning Model with Attention-Geometry Adapter for Incorrect Information Detection
Zhongxing Zhang, Emily K. Vraga, Jisu Huh, Jaideep Srivastava
摘要
Incorrect information poses significant challenges by disrupting content veracity and integrity, yet most detection approaches struggle to jointly balance textual content verification with external knowledge modification under collapsed attention geometries. To address this issue, we propose a dual-head reasoning framework, BiMind, which disentangles content-internal reasoning from knowledgeaugmented reasoning. In BiMind, we introduce three core innovations: (i) an attention geometry adapter that reshapes attention logits via token-conditioned offsets and mitigates attention collapse; (ii) a self-retrieval knowledge mechanism, which constructs an in-domain semantic memory through kNN retrieval and injects retrieved neighbors via feature-wise linear modulation; (iii) the uncertainty-aware fusion strategies, including entropy-gated fusion and a trainable agreement head, stabilized by a symmetric Kullback-Leibler agreement regularizer. To quantify the knowledge contributions, we define a novel metric, Value-of-eXperience (VoX), to measure instance-wise logit gains from knowledge-augmented reasoning. Experiment results on public datasets demonstrate that our BiMind model outperforms advanced detection approaches and provides interpretable diagnostics on when and why knowledge matters. Our BiMind model and the tested datasets are available at https://github.com/cvzh/BiMind .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper14
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni 等NeurIPS 2020 · 被引用 19,162 次
- Deberta: decoding-Enhanced Bert with Disentangled AttentionPengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu ChenICLR 2021 · 被引用 3,729 次
- Rumor Detection on Social Media with Bi-Directional Graph Convolutional NetworksTian Bian, Xi Xiao, Tingyang Xu, Peilin Zhao 等AAAI 2020 · 被引用 773 次
- KAN: Knowledge-aware Attention Network for Fake News DetectionYaqian Dun, Kefei Tu, Chen Chen, Chunyan Hou 等AAAI 2021 · 被引用 142 次
- Divide-and-Conquer: Post-User Interaction Network for Fake News Detection on Social MediaErxue Min, Yu Rong, Yatao Bian, Tingyang Xu 等WWW 2022 · 被引用 82 次
相关 Paper
- Knowledge-Augmented Language Model VerificationJinheon Baek, Soyeong Jeong, Minki Kang, Jong C. Park 等EMNLP 2023 · 被引用 12 次
- Bridging External and Parametric Knowledge: Mitigating Hallucination of LLMs with Shared-Private Semantic Synergy in Dual-Stream KnowledgeYi Sui, Chaozhuo Li, Chen Zhang, Dawei Song 等EMNLP 2025 · 被引用 1 次
- BiDeV: Bilateral Defusing Verification for Complex Claim Fact-CheckingYuxuan Liu, Hongda Sun, Wenya Guo, Xinyan Xiao 等AAAI 2025 · 被引用 11 次
- From Extraction to Deduction: Resolving Functional Misalignment in RAG via a Collaborative Critic-Reasoner FrameworkYufei Chen, Yao Wang, Haibin Zhang, Hualin zhou 等ICML 2026
- Differential-Aware Synergy of Quantity and Topology for Hyper-Relational Knowledge Graphs with Numeric EntitiesMing Yin, Neng GaoKDD 2026
