Ontologically Faithful Generation of Non-Player Character Dialogues
Nathaniel Weir, Ryan Thomas, Randolph D'Amore, Kellie Hill, Benjamin Van Durme, Harsh Jhamtani
Abstract
We introduce a language generation dataset grounded in a popular video game. KNUDGE (KNowledge Constrained User-NPC Dialogue GEneration) requires models to produce trees of dialogue between video game characters that accurately reflect quest and entity specifications stated in natural language. KNUDGE is constructed from side quest dialogues drawn directly from game data of Obsidian Entertainment's The Outer Worlds, leading to real-world complexities in generation: (1) utterances must remain faithful to the game lore, including character personas and backstories; (2) a dialogue must accurately reveal new quest details to the human player; and (3) dialogues are large trees as opposed to linear chains of utterances. We report results for a set of neural generation models using supervised and in-context learning techniques; we find competent performance but room for future work addressing the challenges of creating realistic, game-quality dialogues.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 496a53f3-1bf4-46c2-8584-ac648925f976Builds on9
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
- G-Eval: NLG Evaluation using Gpt-4 with Better Human AlignmentYang Liu, Dan Iter, Yichong Xu, Shuohang Wang et al.EMNLP 2023 · 549 citations
- doc2dial: A Goal-Oriented Document-Grounded Dialogue DatasetSong Feng, Hui Wan, R. Chulaka Gunasekara, Siva Sankalp Patel et al.EMNLP 2020 · 87 citations
- Generating Interactive Worlds with TextAngela Fan, Jack Urbanek, Pratik Ringshia, Emily Dinan et al.AAAI 2020 · 30 citations
Related papers
- Personalized Quest and Dialogue Generation in Role-Playing Games: A Knowledge Graph- and Language Model-based ApproachTrevor Ashby, Braden K. Webb, Gregory Knapp, Jackson Searle et al.CHI 2023 · 64 citations
- Situated Dialogue Learning through Procedural Environment GenerationPrithviraj Ammanabrolu, Renee Jia, Mark O. RiedlACL 2022
- CoLV: A Collaborative Latent Variable Model for Knowledge-Grounded Dialogue GenerationHaolan Zhan, Lei Shen, Hongshen Chen, Hainan ZhangEMNLP 2021 · 15 citations
- Open-domain Video Commentary GenerationEdison Marrese-Taylor, Yumi Hamazono, Tatsuya Ishigaki, Goran Topic et al.EMNLP 2022 · 2 citations
- KPT: Keyword-Guided Pre-training for Grounded Dialog GenerationQi Zhu, Fei Mi, Zheng Zhang, Yasheng Wang et al.AAAI 2023 · 5 citations
