Seen to Unseen: Exploring Compositional Generalization of Multi-Attribute Controllable Dialogue Generation
Weihao Zeng, Lulu Zhao, Keqing He, Ruotong Geng, Jingang Wang, Wei Wu, Weiran Xu
Abstract
Existing controllable dialogue generation work focuses on the single-attribute control and lacks generalization capability to out-of-distribution multiple attribute combinations. In this paper, we explore the compositional generalization for multi-attribute controllable dialogue generation where a model can learn from seen attribute values and generalize to unseen combinations. We propose a prompt-based disentangled controllable dialogue generation model, DCG. It learns attribute concept composition by generating attribute-oriented prompt vectors and uses a disentanglement loss to disentangle different attributes for better generalization. Besides, we design a unified reference-free evaluation framework for multiple attributes with different levels of granularities. Experiment results on two benchmarks prove the effectiveness of our method and the evaluation metric.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext edc53f36-0eff-45f6-8f0f-8234a8fea020Cited by top-tier papers3
- Position: LLMs Can be Good Tutors in English EducationJingheng Ye, Shen Wang, Deqing Zou, Yibo Yan et al.EMNLP 2025 · 2 citations
- Benchmarking and Improving Compositional Generalization of Multi-aspect Controllable Text GenerationTianqi Zhong, Zhaoyi Li, Quan Wang, Linqi Song et al.ACL 2024
- ECO Decoding: Entropy-Based Control for Controllability and Fluency in Controllable Dialogue GenerationSeungmin Shin, Dooyoung Kim, Youngjoong KoEMNLP 2025
Builds on11
- BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
- Plug and Play Language Models: A Simple Approach to Controlled Text GenerationSumanth Dathathri, Andrea Madotto, Janice Lan, Jane Hung et al.ICLR 2020 · 1,166 citations
- The Power of Scale for Parameter-Efficient Prompt TuningBrian Lester, Rami Al-Rfou, Noah ConstantEMNLP 2021 · 94 citations
- UNION: An Unreferenced Metric for Evaluating Open-ended Story GenerationJian Guan, Minlie HuangEMNLP 2020 · 46 citations
- Disentangled Sequence to Sequence Learning for Compositional GeneralizationHao Zheng, Mirella LapataACL 2022 · 41 citations
Related papers
- Semantic Space Grounded Weighted Decoding for Multi-Attribute Controllable Dialogue GenerationZhiling Zhang, Mengyue Wu, Kenny Q. ZhuEMNLP 2023 · 2 citations
- DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text GenerationHanqing Zhang, Dawei SongEMNLP 2022 · 21 citations
- Compositional Task Representations for Large Language ModelsNan Shao, Zefan Cai, Hanwei Xu, Chonghua Liao et al.ICLR 2023
- A Disentangled-Attention Based Framework with Persona-Aware Prompt Learning for Dialogue GenerationPingsheng Liu, Zhengjie Huang, Xiechi Zhang, Linlin Wang et al.AAAI 2023 · 8 citations
- CompSlider: Compositional Slider for Disentangled Multiple-Attribute Image GenerationZixin Zhu, Kevin Duarte, Mamshad Nayeem Rizve, Chengyuan Xu et al.ICCV 2025
