Lune

ACL Findings2025

ChatMap: Mining Human Thought Processes for Customer Service Chatbots via Multi-Agent Collaboration

Xinyi Jiang, Tianyi Hu, Yuheng Qin, Guoming Wang, Zhou Huan, Kehan Chen, Gang Huang, Rongxing Lu, Siliang Tang

Abstract

Leveraging Large Language Models (LLMs) to build domain-specific conversational agents, especially for e-commerce customer service chatbots, is a growing focus. While existing methods enhance dialogue performance by extracting core patterns from dialogue data and integrating them into models, two key challenges persist: (1) heavy reliance on human experts for dialogue strategy induction, and (2) LLMbased automatic extraction often focuses on summarizing specific behaviors, neglecting the underlying thought processes behind strategy selection. In this paper, we present ChatMap, which focuses on enhancing customer service Chatbots by mining thought processes using a Multi-Agent aPproach. Specifically, the process begins by extracting customer requests and solutions from a raw dialogue dataset, followed by clustering similar requests, analyzing the thought processes behind solutions, and refining service thoughts. Through a quality inspection and reflection mechanism, the final service thought dataset is generated, helping chatbots provide more appropriate responses. Offline experimental results show that ChatMap performs comparably to manually annotated thought processes and significantly outperforms other baselines, demonstrating its ability to automate human annotation and enhance dialogue capabilities through strategic understanding. Online A/B tests on Taobao, a popular e-commerce platform in China reveal that ChatMap can better improve customer satisfaction and address customer requests from a business perspective.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

2 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate cites Generative Agents: Interactive Simulacra of Human Behavior
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers2

  1. METRO: Towards Strategy Induction from Expert Dialogue Transcripts for Non-collaborative DialoguesHaofu Yang, Jiaji Liu, Chen Huang, Faguo Wu et al.ACL 2026 · 2 citations
  2. Benchmarking and Learning Real-World Customer Service DialogueTianhong Gao, Jundong Shen, Jiapeng Wang, Bei Shi et al.ACL 2026

Builds on17

  1. Self-Refine: Iterative Refinement with Self-FeedbackAman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan et al.NeurIPS 2023 · 4,972 citations
  2. Generative Agents: Interactive Simulacra of Human BehaviorJoon Sung Park, Joseph C. O'Brien, Carrie Jun Cai, Meredith Ringel Morris et al.UIST 2023 · 1,882 citations
  3. ChatEval: Towards Better LLM-based Evaluators through Multi-Agent DebateChi-Min Chan, Weize Chen, Yusheng Su, Jianxuan Yu et al.ICLR 2024 · 871 citations
  4. Self-Consistency Improves Chain of Thought Reasoning in Language ModelsXuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le et al.ICLR 2023 · 681 citations
  5. Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP TasksYizhong Wang, Swaroop Mishra, Pegah Alipoormolabashi, Yeganeh Kordi et al.EMNLP 2022 · 238 citations

Related papers

  1. LLM aided semi-supervision for efficient Extractive Dialog SummarizationNishant Mishra, Gaurav Sahu, Iacer Calixto, Ameen Abu-Hanna et al.EMNLP Findings 2023 · 7 citations
  2. ChatPattern: Layout Pattern Customization via Natural LanguageZixiao Wang, Yunheng Shen, Xufeng Yao, Wenqian Zhao et al.DAC 2024 · 9 citations
  3. TWEETSUMM - A Dialog Summarization Dataset for Customer ServiceGuy Feigenblat, R. Chulaka Gunasekara, Benjamin Sznajder, Sachindra Joshi et al.EMNLP Findings 2021 · 22 citations
  4. Flowchart-Based Decision Making with Large Language ModelsYuuki Yamanaka, Hiroshi Takahashi, Tomoya YamashitaACL Findings 2025
  5. Chain-of-Interactions: Multi-step Iterative ICL Framework for Abstractive Task-Oriented Dialogue Summarization of Conversational AI InteractionsJason S. Lucas, Ali Al-Lawati, Mahjabin Nahar, John Chen et al.EMNLP Findings 2025
Dusk over the sea between two cliffs drawn in fine vertical lines