Lune

EMNLP Findings2023

SGP-TOD: Building Task Bots Effortlessly via Schema-Guided LLM Prompting

Xiaoying Zhang, Baolin Peng, Kun Li, Jingyan Zhou, Helen Meng

Abstract

Building and maintaining end-to-end task bots using minimal human effort is a longstanding challenge in dialog research. In this work, we introduce SGP-TOD, S ¯chema-G ¯uided P ¯rompting for building T ¯ask-O ¯riented D ¯ialog systems effortlessly based on large language models (LLMs). Utilizing the predefined task schema, i.e., belief instruction and dialog policy, we instruct fixed LLMs to generate appropriate responses on novel tasks, without the need for training data. Specifically, SGP-TOD comprises three components: an LLM for interacting with users, a Dialog State Tracking (DST) Prompter to aid the LLM in tracking dialog states with the given belief instruction, and a Policy Prompter to direct the LLM to generate proper responses adhering to the provided dialog policy. Experimental results on Multiwoz, RADDLE, and STAR datasets show that our training-free strategy, SGP-TOD, yields stateof-the-art (SOTA) zero-shot performance, significantly surpassing the few-shot approaches. In a domain-extension setting, SGP-TOD aptly adapts to new functionalities by merely adding supplementary schema rules. We make our code and data publicly available. 1

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 10 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers10

  1. Plug-and-Play Policy Planner for Large Language Model Powered Dialogue AgentsYang Deng, Wenxuan Zhang, Wai Lam, See-Kiong Ng et al.ICLR 2024 · 86 citations
  2. Advancing LLM Reasoning with Natural Language and Numerical FeedbackXiaoying Zhang, Yipeng Zhang, Hao Sun, Kaituo Feng et al.ICML 2026 · 79 citations
  3. Large Language Models as Zero-shot Dialogue State Tracker through Function CallingZekun Li, Zhiyu Chen, Mike Ross, Patrick Huber et al.ACL 2024 · 9 citations
  4. Planning Like Human: A Dual-process Framework for Dialogue PlanningTao He, Lizi Liao, Yixin Cao, Yuanxing Liu et al.ACL 2024 · 7 citations
  5. Zero-shot Cross-domain Dialogue State Tracking via Context-aware Auto-prompting and Instruction-following Contrastive DecodingXiaoyu Dong, Yujie Feng, Zexin Lu, Guangyuan Shi et al.EMNLP 2024 · 3 citations

Builds on19

  1. Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
  2. BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
  3. Calibrate Before Use: Improving Few-shot Performance of Language ModelsZihao Zhao, Eric Wallace, Shi Feng, Dan Klein et al.ICML 2021 · 1,843 citations
  4. Towards Scalable Multi-Domain Conversational Agents: The Schema-Guided Dialogue DatasetAbhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta et al.AAAI 2020 · 707 citations
  5. A Simple Language Model for Task-Oriented DialogueEhsan Hosseini-Asl, Bryan McCann, Chien-Sheng Wu, Semih Yavuz et al.NeurIPS 2020 · 590 citations

Related papers

  1. An Adaptive Prompt Generation Framework for Task-oriented Dialogue SystemJun Gao, Liuyu Xiang, Huijia Wu, Han Zhao et al.EMNLP Findings 2023 · 9 citations
  2. Rethinking Task-Oriented Dialogue Systems: From Complex Modularity to Zero-Shot Autonomous AgentHeng-Da Xu, Xian-Ling Mao, Puhai Yang, Fanshu Sun et al.ACL 2024
  3. Task-Optimized Adapters for an End-to-End Task-Oriented Dialogue SystemNamo Bang, Jeehyun Lee, Myoung-Wan KooACL Findings 2023 · 25 citations
  4. CINS: Comprehensive Instruction for Few-Shot Learning in Task-Oriented Dialog SystemsFei Mi, Yasheng Wang, Yitong LiAAAI 2022 · 46 citations
  5. AnyTOD: A Programmable Task-Oriented Dialog SystemJeffrey Zhao, Yuan Cao, Raghav Gupta, Harrison Lee et al.EMNLP 2023 · 4 citations
Dusk over the sea between two cliffs drawn in fine vertical lines