Semantic Space Grounded Weighted Decoding for Multi-Attribute Controllable Dialogue Generation
Zhiling Zhang, Mengyue Wu, Kenny Q. Zhu
Abstract
Controlling chatbot utterance generation with multiple attributes such as personalities, emotions and dialogue acts is a practically useful but under-studied problem. We propose a novel framework called DASC that possesses strong controllability with a weighted decoding paradigm, while improving generation quality with the grounding in an attribute semantics space. Generation with multiple attributes is then intuitively implemented with an interpolation of multiple attribute embeddings, which results in substantial reduction in the model sizes. Experiments show that DASC can achieve high control accuracy in generation task with the simultaneous control of 3 aspects while also producing interesting and reasonably sensible responses, even in an out-of-distribution robustness test. 1
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7cb00fd8-0f72-4192-80a8-8589a8876dfcCited by top-tier papers1
Ask how each one uses itBuilds on12
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
- The Curious Case of Neural Text DegenerationAri Holtzman, Jan Buys, Li Du, Maxwell Forbes et al.ICLR 2020 · 4,112 citations
- Generative Agents: Interactive Simulacra of Human BehaviorJoon Sung Park, Joseph C. O'Brien, Carrie Jun Cai, Meredith Ringel Morris et al.UIST 2023 · 1,882 citations
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
Related papers
- Seen to Unseen: Exploring Compositional Generalization of Multi-Attribute Controllable Dialogue GenerationWeihao Zeng, Lulu Zhao, Keqing He, Ruotong Geng et al.ACL 2023 · 1 citation
- A Distributional Lens for Multi-Aspect Controllable Text GenerationYuxuan Gu, Xiaocheng Feng, Sicheng Ma, Lingyuan Zhang et al.EMNLP 2022 · 16 citations
- Air-Decoding: Attribute Distribution Reconstruction for Decoding-Time Controllable Text GenerationTianqi Zhong, Quan Wang, Jingxuan Han, Yongdong Zhang et al.EMNLP 2023 · 7 citations
- A Disentangled-Attention Based Framework with Persona-Aware Prompt Learning for Dialogue GenerationPingsheng Liu, Zhengjie Huang, Xiechi Zhang, Linlin Wang et al.AAAI 2023 · 8 citations
- V-VAE: A Variational Auto Encoding Framework Towards Fine-Grained Control over Human-Like ChatQi Lin, Weikai Xu, Lisi Chen, Bin DaiEMNLP 2025
