Counterfactual-based Cognitive Alignment In-Context Learning for Relation Extraction
Qibin Li, Shengyuan Bai, Nai Zhou, Nianmin Yao
Abstract
Large Language Models (LLMs) have demonstrated remarkable In-Context learning (ICL) capabilities for relation extraction (RE). While ICL has shown promise in RE tasks, current approaches face challenges in example selection and utilization. These challenges stem from the misalignment between example selection methods and LLMs' inherent cognitive processing mechanisms, particularly in pattern recognition and relational reasoning. To address these limitations, we propose Counterfactual Cognitive Alignment (CCA), a novel framework that systematically enhances ICL performance in RE by aligning example selection with cognitive principles underlying human relational reasoning. The framework incorporates a cognitive-inspired counterfactual generation mechanism that creates semantically diverse yet relationally coherent examples, mirroring human "what-if" reasoning processes. Additionally, it employs a cognitive alignment approach that integrates structural identification features with semantic understanding to better align with LLMs cognitive processing patterns. Extensive experiments across multiple RE benchmarks reveal the effectiveness of our cognitive alignment approach through the synergistic integration of counterfactual reasoning and cognitively-guided selection.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 50015fa2-0606-4b19-b472-93ab0b2fb6edBuilds on13
- Self-Refine: Iterative Refinement with Self-FeedbackAman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan et al.NeurIPS 2023 · 4,972 citations
- SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenEMNLP 2021 · 2,496 citations
- KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation ExtractionXiang Chen, Ningyu Zhang, Xin Xie, Shumin Deng et al.WWW 2022 · 488 citations
- OneRel: Joint Entity and Relation Extraction with One Module in One StepYuming Shang, Heyan Huang, Xianling MaoAAAI 2022 · 200 citations
- Packed Levitated Marker for Entity and Relation ExtractionDeming Ye, Yankai Lin, Peng Li, Maosong SunACL 2022 · 140 citations
Related papers
- Cog-RAG: Cognitive-Inspired Dual-Hypergraph with Theme Alignment Retrieval-Augmented GenerationHao Hu, Yifan Feng, Ruoxue Li, Rundong Xue et al.AAAI 2026 · 5 citations
- Retrieval is Not Enough: Enhancing RAG through Test-Time Critique and OptimizationJiaqi Wei, Hao Zhou, Xiang Zhang, Di Zhang et al.NeurIPS 2025 · 14 citations
- Enhancing Relation Extraction via Supervised Rationale Verification and FeedbackYongqi Li, Xin Miao, Shen Zhou, Mayi Xu et al.AAAI 2025
- ReCogLab: a framework testing relational reasoning & cognitive hypotheses on LLMsAndrew Liu, Henry Prior, Gargi Balasubramaniam, Rivka Moroshko et al.ICLR 2025
- Retrieval over Classification: Integrating Relation Semantics for Multimodal Relation ExtractionLei Hei, Tingjing Liao, Peiyingxin, Yiyang Qi et al.EMNLP 2025
