EMNLP Findings2024
LLMs as Collaborator: Demands-Guided Collaborative Retrieval-Augmented Generation for Commonsense Knowledge-Grounded Open-Domain Dialogue Systems
Abstract
Capturing the unique knowledge demands for each dialogue context plays a crucial role in commonsense knowledge-grounded response generation. However, current CoT-based and RAG-based methods are still unsatisfactory in the era of LLMs because 1) CoT often overestimates the capabilities of LLMs and treats them as isolated knowledge Producers; thus, CoT only uses the inherent knowledge of LLM itself and then suffers from the hallucination and outdated knowledge, and 2) RAG underestimates LLMs because LLMs are the passive Receivers that can only use the knowledge retrieved by external retrievers. In contrast, this work regards LLMs as interactive Collaborators and proposes a novel DCRAG 1 (Demands-Guided Collaborative RAG) to leverage the knowledge from both LLMs and the external knowledge graph. Specifically, DCRAG designs three Thought-then-Generate stages to collaboratively investigate knowledge demands, followed by a Demands-Guided Knowledge Retrieval to retrieve external knowledge by interacting with LLMs. Extensive experiments and in-depth analyses on English DailyDialog and Chinese Diamante datasets proved DCRAG can effectively capture knowledge demands and bring higher-quality responses.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
1 top-tier paper has cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- G-Eval: NLG Evaluation using Gpt-4 with Better Human Alignment cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- Retrieval Augmentation Reduces Hallucination in Conversation cites Sequential Latent Knowledge Selection for Knowledge-Grounded Dialogue
- Breaking the Trade-Off Between Faithfulness and Expressiveness for Large Language Models cites Sequential Latent Knowledge Selection for Knowledge-Grounded Dialogue
- Breaking the Trade-Off Between Faithfulness and Expressiveness for Large Language Models cites G-Eval: NLG Evaluation using Gpt-4 with Better Human Alignment
- Breaking the Trade-Off Between Faithfulness and Expressiveness for Large Language Models cites Large Language Models Struggle to Learn Long-Tail Knowledge
- Breaking the Trade-Off Between Faithfulness and Expressiveness for Large Language Models cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Cited by top-tier papers1
Builds on28
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Large Language Models Struggle to Learn Long-Tail KnowledgeNikhil Kandpal, Haikang Deng, Adam Roberts, Eric Wallace et al.ICML 2023 · 623 citations
- Retrieval Augmentation Reduces Hallucination in ConversationKurt Shuster, Spencer Poff, Moya Chen, Douwe Kiela et al.EMNLP Findings 2021 · 579 citations
- G-Eval: NLG Evaluation using Gpt-4 with Better Human AlignmentYang Liu, Dan Iter, Yichong Xu, Shuohang Wang et al.EMNLP 2023 · 549 citations
- Sequential Latent Knowledge Selection for Knowledge-Grounded DialogueByeongchang Kim, Jaewoo Ahn, Gunhee KimICLR 2020 · 179 citations
Related papers
- Towards Open-World Retrieval-Augmented Generation on Knowledge Graph: A Multi-Agent Collaboration FrameworkJiasheng Xu, Mingda Li, Yongqiang Tang, Peijie Wang et al.WWW 2026
- MemGraphRAG: Memory-based Multi-Agent System for Graph Retrieval-Augmented GenerationChuanjie Wu, Zhishang Xiang, Yunbo Tang, Zerui Chen et al.KDD 2026 · 1 citation
- OG-RAG: Ontology-grounded retrieval-augmented generation for large language modelsKartik Sharma, Peeyush Kumar, Yunqing LiEMNLP 2025 · 6 citations
- LeanRAG: Knowledge-Graph-Based Generation with Semantic Aggregation and Hierarchical RetrievalYaoze Zhang, Rong Wu, Pinlong Cai, Xiaoman Wang et al.AAAI 2026 · 7 citations
- HyKGE: A Hypothesis Knowledge Graph Enhanced RAG Framework for Accurate and Reliable Medical LLMs ResponsesXinke Jiang, Ruizhe Zhang, Yongxin Xu, Rihong Qiu et al.ACL 2025
