Lune

EMNLP Findings2024

Minimal Yet Big Impact: How AI Agent Back-channeling Enhances Conversational Engagement through Conversation Persistence and Context Richness

Jin Yea Jang, Saim Shin, Gahgene Gweon

Abstract

The increasing use of AI agents in conversational services, such as counseling, highlights the importance of back-channeling (BC) as an active listening strategy to enhance conversational engagement. BC improves conversational engagement by providing timely acknowledgments and encouraging the speaker to continue talking. This study investigates the effect of BC provided by an AI agent on conversational engagement, offering insights for the future design of AI conversational services. We conducted an experiment with 55 participants, divided into Todak_BC and To-dak_NoBC groups based on the presence or absence of the BC feature in Todak, a conversational agent. Each participant engaged in nine sessions with predetermined subjects and questions. We collected and analyzed approximately 6 hours and 30 minutes of conversation logs to evaluate conversational engagement using both quantitative (conversation persistence, including conversation duration and number of utterances) and qualitative metrics (context richness, including self-disclosure and topic diversity). The findings reveal significantly higher conversational engagement in the Todak_BC group compared to the Todak_NoBC group across all metrics (p < 0.05). Additionally, the impact of BC varies across sessions, suggesting that conversation characteristics such as question type and topic sensitivity can influence BC effectiveness.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Alexa as an Active Listener: How Backchanneling Can Elicit Self-Disclosure and Promote User Experience cites "I Hear You, I Feel You": Encouraging Deep Self-disclosure through a Chatbot
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on4

  1. "I Hear You, I Feel You": Encouraging Deep Self-disclosure through a ChatbotYi-Chieh Lee, Naomi Yamashita, Yun Huang, Wai FuCHI 2020 · 333 citations
  2. Predictive Engagement: An Efficient Metric for Automatic Evaluation of Open-Domain Dialogue SystemsSarik Ghazarian, Ralph M. Weischedel, Aram Galstyan, Nanyun PengAAAI 2020 · 62 citations
  3. Short Text Topic Modeling with Topic Distribution Quantization and Negative Sampling DecoderXiaobao Wu, Chunping Li, Yan Zhu, Yishu MiaoEMNLP 2020 · 61 citations
  4. Alexa as an Active Listener: How Backchanneling Can Elicit Self-Disclosure and Promote User ExperienceEugene Cho, Nasim Motalebi, S. Shyam Sundar, Saeed AbdullahCSCW 2022 · 36 citations

Related papers

  1. TalkTive: A Conversational Agent Using Backchannels to Engage Older Adults in Neurocognitive Disorders ScreeningZijian Ding, Jiawen Kang, Tinky Oi Ting Ho, Ka Ho Wong et al.CHI 2022 · 30 citations
  2. Hear You in Silence: Designing for Active Listening in Human Interaction with Conversational Agents Using Context-Aware PacingZhihan Jiang, Qianhui Chen, Chu Zhang, Yanheng Li et al.CHI 2026 · 5 citations
  3. Exploring Semi-Supervised Learning for Predicting Listener BackchannelsVidit Jain, Maitree Leekha, Rajiv Ratn Shah, Jainendra ShuklaCHI 2021 · 17 citations
  4. Synlogue with Aizuchi-bot: Investigating the Co-Adaptive and Open-Ended Interaction ParadigmKazumi Yoshimura, Dominique Chen, Olaf WitkowskiCHI 2024 · 3 citations
  5. How Should the Agent Communicate to the Group? Communication Strategies of a Conversational Agent in Group Chat DiscussionsHyo Jin Do, Ha Kyung Kong, Jaewook Lee, Brian P. BaileyCSCW 2022 · 30 citations
Dusk over the sea between two cliffs drawn in fine vertical lines