ACL Findings2023
Chain of Thought Prompting Elicits Knowledge Augmentation
Dingjun Wu, Jing Zhang, Xinmei Huang
Abstract
The knowledge-augmented deep learning paradigm refers to a paradigm in which domain knowledge is identified and integrated into deep models. Conventional methods typically employ task-specific approaches to gather external knowledge from various sources. In contrast, large language models are extensively pre-trained and can serve as a comprehensive source of external knowledge. In this paper, we propose CoT-KA, a Chain-of-Thought-based method that augments knowledge for deep learning. CoT-KA avoids the need for additional knowledge retrieval or knowledge reasoning models, as required in conventional augmentation methods. Our results demonstrate that CoT-KA outperforms both pure CoT-based methods and the non-augmented method across the majority of eleven publicly available benchmarks for various reasoning tasks 1 .
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
8 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Self-Consistency Improves Chain of Thought Reasoning in Language Models cites Large Language Models are Zero-Shot Reasoners
- Large Language Models are Zero-Shot Reasoners cites Self-Consistency Improves Chain of Thought Reasoning in Language Models
- Self-Consistency Improves Chain of Thought Reasoning in Language Models cites Language Models are Few-Shot Learners
- Self-Consistency Improves Chain of Thought Reasoning in Language Models cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- Chain-of-Thought Prompting Elicits Reasoning in Large Language Models cites Self-Consistency Improves Chain of Thought Reasoning in Language Models
- Chain-of-Thought Improves Text Generation with Citations in Large Language Models cites Large Language Models are Zero-Shot Reasoners
- Chain-of-Thought Improves Text Generation with Citations in Large Language Models cites Language Models are Few-Shot Learners
- Chain-of-Thought Improves Text Generation with Citations in Large Language Models cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- Large Language Models are Zero-Shot Reasoners cites Language Models are Few-Shot Learners
- Large Language Models are Zero-Shot Reasoners cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- CDW-CoT: Clustered Distance-Weighted Chain-of-Thoughts Reasoning cites Large Language Models are Zero-Shot Reasoners
- CDW-CoT: Clustered Distance-Weighted Chain-of-Thoughts Reasoning cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- Large Language Models Are Clinical Reasoners: Reasoning-Aware Diagnosis Framework with Prompt-Generated Rationales cites Large Language Models are Zero-Shot Reasoners
- Large Language Models Are Clinical Reasoners: Reasoning-Aware Diagnosis Framework with Prompt-Generated Rationales cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Cited by top-tier papers8
- Iterative Reasoning Preference OptimizationRichard Yuanzhe Pang, Weizhe Yuan, He He, Kyunghyun Cho et al.NeurIPS 2024 · 287 citations
- Large Language Models Are Clinical Reasoners: Reasoning-Aware Diagnosis Framework with Prompt-Generated RationalesTaeyoon Kwon, Kai Tzu-iunn Ong, Dongjin Kang, Seungjun Moon et al.AAAI 2024 · 71 citations
- Chain-of-Thought Improves Text Generation with Citations in Large Language ModelsBin Ji, Huijun Liu, Mingzhe Du, See-Kiong NgAAAI 2024 · 17 citations
- SeGA: Preference-Aware Self-Contrastive Learning with Prompts for Anomalous User Detection on TwitterYing-Ying Chang, Wei-Yao Wang, Wen-Chih PengAAAI 2024 · 11 citations
- CDW-CoT: Clustered Distance-Weighted Chain-of-Thoughts ReasoningYuanheng Fang, Guoqing Chao, Wenqiang Lei, Shaobo Li et al.AAAI 2025 · 4 citations
Builds on10
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Large Language Models are Zero-Shot ReasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo et al.NeurIPS 2022 · 8,168 citations
- ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
- Self-Consistency Improves Chain of Thought Reasoning in Language ModelsXuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le et al.ICLR 2023 · 681 citations
Related papers
- KAM-CoT: Knowledge Augmented Multimodal Chain-of-Thoughts ReasoningDebjyoti Mondal, Suraj Modi, Subhadarshi Panda, Rituraj Singh et al.AAAI 2024 · 96 citations
- Probabilistic Tree-of-thought Reasoning for Answering Knowledge-intensive Complex QuestionsShulin Cao, Jiajie Zhang, Jiaxin Shi, Xin Lv et al.EMNLP Findings 2023 · 17 citations
- Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled DataKashun Shum, Shizhe Diao, Tong ZhangEMNLP Findings 2023 · 63 citations
- CoT-RAG: Integrating Chain of Thought and Retrieval-Augmented Generation to Enhance Reasoning in Large Language ModelsFeiyang Li, Peng Fang, Zhan Shi, Arijit Khan et al.EMNLP Findings 2025 · 11 citations
- CoTKR: Chain-of-Thought Enhanced Knowledge Rewriting for Complex Knowledge Graph Question AnsweringYike Wu, Yi Huang, Nan Hu, Yuncheng Hua et al.EMNLP 2024 · 9 citations
