Knowledge Enhanced Reflection Generation for Counseling Dialogues
Siqi Shen, Verónica Pérez-Rosas, Charles Welch, Soujanya Poria, Rada Mihalcea
Abstract
In this paper, we study the effect of commonsense and domain knowledge while generating responses in counseling conversations using retrieval and generative methods for knowledge integration. We propose a pipeline that collects domain knowledge through web mining, and show that retrieval from both domain-specific and commonsense knowledge bases improves the quality of generated responses. We also present a model that incorporates knowledge generated by COMET using soft positional encoding and masked self-attention.We show that both retrieved and COMET-generated knowledge improve the system’s performance as measured by automatic metrics and also by human evaluation. Lastly, we present a comparative study on the types of knowledge encoded by our system showing that causal and intentional relationships benefit the generation task more than other types of commonsense relations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b8d712e8-0e1d-4321-8c54-caa4ea959517Cited by top-tier papers6
- Knowledge-enhanced Mixed-initiative Dialogue System for Emotional Support ConversationsYang Deng, Wenxuan Zhang, Yifei Yuan, Wai LamACL 2023 · 31 citations
- Multi-Level Feedback Generation with Large Language Models for Empowering Novice Peer CounselorsAlicja Chaszczewicz, Raj Sanjay Shah, Ryan Louie, Bruce A. Arnow et al.ACL 2024 · 12 citations
- Dynamic Demonstration Retrieval and Cognitive Understanding for Emotional Support ConversationZhe Xu, Daoyuan Chen, Jiayi Kuang, Zihao Yi et al.SIGIR 2024 · 9 citations
- Task-Adaptive Tokenization: Enhancing Long-Form Text Generation Efficacy in Mental Health and BeyondSiyang Liu, Naihao Deng, Sahand Sabour, Yilin Jia et al.EMNLP 2023 · 7 citations
- Can LLM-Simulated Practice and Feedback Upskill Human Counselors? A Randomized Study with 90+ Novice CounselorsRyan Louie, Raj Sanjay Shah, Ifdita Hasan Orney, Juan Pablo Pacheco et al.CHI 2026 · 7 citations
Builds on9
- BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
- K-BERT: Enabling Language Representation with Knowledge GraphWeijie Liu, Peng Zhou, Zhe Zhao, Zhiruo Wang et al.AAAI 2020 · 898 citations
- (Comet-) Atomic 2020: On Symbolic and Neural Commonsense Knowledge GraphsJena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, Jeff Da et al.AAAI 2021 · 458 citations
- Knowledge-Grounded Dialogue Generation with Pre-trained Language ModelsXueliang Zhao, Wei Wu, Can Xu, Chongyang Tao et al.EMNLP 2020 · 153 citations
Related papers
- Using Commonsense Knowledge to Answer Why-QuestionsYash Kumar Lal, Niket Tandon, Tanvi Aggarwal, Horace Liu et al.EMNLP 2022 · 7 citations
- Generated Knowledge Prompting for Commonsense ReasoningJiacheng Liu, Alisa Liu, Ximing Lu, Sean Welleck et al.ACL 2022
- Keyword-Guided Neural Conversational ModelPeixiang Zhong, Yong Liu, Hao Wang, Chunyan MiaoAAAI 2021 · 38 citations
- Contextualize Knowledge Bases with Transformer for End-to-end Task-Oriented Dialogue SystemsYanjie Gou, Yinjie Lei, Lingqiao Liu, Yong Dai et al.EMNLP 2021 · 11 citations
- Improving Knowledge-Aware Dialogue Generation via Knowledge Base Question AnsweringJian Wang, Junhao Liu, Wei Bi, Xiaojiang Liu et al.AAAI 2020 · 52 citations
