End-to-End Learning of Flowchart Grounded Task-Oriented Dialogs
Dinesh Raghu, Shantanu Agarwal, Sachindra Joshi, Mausam
Abstract
We propose a novel problem within end-toend learning of task oriented dialogs (TOD), in which the dialog system mimics a troubleshooting agent who helps a user by diagnosing their problem (e.g., car not starting). Such dialogs are grounded in domain-specific flowcharts, which the agent is supposed to follow during the conversation. Our task exposes novel technical challenges for neural TOD, such as grounding an utterance to the flowchart without explicit annotation, referring to additional manual pages when user asks a clarification question, and ability to follow unseen flowcharts at test time. We release a dataset (FLODIAL) consisting of 2,738 dialogs grounded on 12 different troubleshooting flowcharts. We also design a neural model, FLONET, which uses a retrieval-augmented generation architecture to train the dialog agent. Our experiments find that FLONET can do zero-shot transfer to unseen flowcharts, and sets a strong baseline for future research. * D. Raghu and S.Agarwal contributed equally to this work. † D. Raghu is an employee at IBM Research. This work was carried out as part of PhD research at IIT Delhi. N3 N2 N1 My Acura ILX is not starting. When I turn the key, the starter doesn't spin. This happened yesterday too and I missed an important appointment Does the voltage of your car battery read more than 12? How do I check the car battery voltage? You can check the car battery voltage using a voltmeter How do I read battery voltage using a voltmeter? In order to get a measurement, touch the black negative probe of the voltmeter to the battery's black … The battery does not read more than 12. Your battery is dead (for now). Find someone to help you jump start your car. This should be a quick fix. I have a friend who can help with that. Thanks for the tip. I'm glad to be of help. Have a good day! (c) Example dialog grounded on flowchart and support documents Starter cranks? Battery read over 12V? Starter spins? Jump start the car
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers8
- Uncertainty of Thoughts: Uncertainty-Aware Planning Enhances Information Seeking in LLMsZhiyuan Hu, Chumin Liu, Xidong Feng, Yilun Zhao et al.NeurIPS 2024 · 43 citations
- InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction TuningPrakhar Gupta, Cathy Jiao, Yi-Ting Yeh, Shikib Mehri et al.EMNLP 2022 · 26 citations
- TOD-Flow: Modeling the Structure of Task-Oriented DialoguesSungryull Sohn, Yiwei Lyu, Anthony Z. Liu, Lajanugen Logeswaran et al.EMNLP 2023 · 3 citations
- On Information Self-Locking in Reinforcement Learning for Active Reasoning of LLM agentsDeyu Zou, Yongqiang Chen, Fan Feng, Mufei Li et al.ICML 2026 · 3 citations
- Feedback-Aware MCTS for Goal-Oriented Information SeekingHarshita Chopra, Chirag ShahNeurIPS 2025 · 2 citations
Builds on7
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- The Curious Case of Neural Text DegenerationAri Holtzman, Jan Buys, Li Du, Maxwell Forbes et al.ICLR 2020 · 4,112 citations
- Towards Scalable Multi-Domain Conversational Agents: The Schema-Guided Dialogue DatasetAbhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta et al.AAAI 2020 · 707 citations
- A Simple Language Model for Task-Oriented DialogueEhsan Hosseini-Asl, Bryan McCann, Chien-Sheng Wu, Semih Yavuz et al.NeurIPS 2020 · 590 citations
- End-to-End Neural Pipeline for Goal-Oriented Dialogue Systems using GPT-2DongHoon Ham, Jeong-Gwan Lee, Youngsoo Jang, Kee-Eung KimACL 2020 · 167 citations
Related papers
- Structural Constraints and Natural Language Inference for End-to-End Flowchart Grounded Dialog Response GenerationDinesh Raghu, Suraj Joshi, Sachindra Joshi, MausamEMNLP 2022 · 2 citations
- CoDial: Interpretable Task-Oriented Dialogue Systems Through Dialogue Flow AlignmentRadin Shayanfar, Chu Fei Luo, Rohan Bhambhoria, Samuel Dahan et al.ACL 2026 · 1 citation
- Rethinking Task-Oriented Dialogue Systems: From Complex Modularity to Zero-Shot Autonomous AgentHeng-Da Xu, Xian-Ling Mao, Puhai Yang, Fanshu Sun et al.ACL 2024
- AnyTOD: A Programmable Task-Oriented Dialog SystemJeffrey Zhao, Yuan Cao, Raghav Gupta, Harrison Lee et al.EMNLP 2023 · 4 citations
- DFA-RAG: Conversational Semantic Router for Large Language Model with Definite Finite AutomatonYiyou Sun, Junjie Hu, Wei Cheng, Haifeng ChenICML 2024 · 4 citations
