ACL Findings2025
MUSE: A Multimodal Conversational Recommendation Dataset with Scenario-Grounded User Profiles
Zihan Wang, Xiaocui Yang, Yongkang Liu, Shi Feng, Daling Wang, Yifei Zhang
摘要
Current conversational recommendation systems focus predominantly on text. However, real-world recommendation settings are generally multimodal, causing a significant gap between existing research and practical applications. To address this issue, we propose Muse, the first multimodal conversational recommendation dataset. Muse comprises 83,148 utterances from 7,000 conversations centered around the Clothing domain. Each conversation contains comprehensive multimodal interactions, rich elements, and natural dialogues. Data in Muse are automatically synthesized by a multi-agent framework powered by multimodal large language models (MLLMs). It innovatively derives user profiles from real-world scenarios rather than depending on manual design and history data for better scalability, and then it fulfills conversation simulation and optimization. Both human and LLM evaluations demonstrate the high quality of conversations in Muse. Additionally, fine-tuning experiments on three MLLMs demonstrate Muse's learnable patterns for recommendations and responses, confirming its value for multimodal conversational recommendation. Our dataset and codes are available at https://anonymous.4open.science/r/Muse-0086.
问 Lune
尽管问,回答会引用原文。
Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。
引用它的顶会 Paper3
- LettinGo: Explore User Profile Generation for Recommendation SystemLu Wang, Di Zhang, Fangkai Yang, Pu Zhao 等KDD 2025 · 2 次引用
- Where and What: Reasoning Dynamic and Implicit Preferences in Situated Conversational RecommendationDongding Lin, Jian Wang, Yongqi Li, Wenjie LiACL 2026
- HARPO: Hierarchical Agentic Reasoning for User-Aligned Conversational RecommendationSubham Raj, Aman Vaibhav Jha, Mayank Anand, Sriparna SahaACL 2026
它引用的 Paper17
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 18,833 次引用
- M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge DistillationJianlyu Chen, Shitao Xiao, Peitian Zhang, Kun Luo 等ACL Findings 2024 · 762 次引用
- Self-Instruct: Aligning Language Models with Self-Generated InstructionsYizhong Wang, Yeganeh Kordi, Swaroop Mishra, Alisa Liu 等ACL 2023 · 540 次引用
- Bridging Language and Items for Retrieval and Recommendation: Benchmarking LLMs as Semantic EncodersYupeng Hou, Jiacheng Li, Xiangjun Fu, Zhankui He 等ACL 2026 · 346 次引用
- Towards Conversational Recommendation over Multi-Type DialogsZeming Liu, Haifeng Wang, Zheng-Yu Niu, Hua Wu 等ACL 2020 · 157 次引用
相关 Paper
- Pearl: A Review-driven Persona-Knowledge Grounded Conversational Recommendation DatasetMinjin Kim, Minju Kim, Hana Kim, Beong-woo Kwak 等ACL Findings 2024 · 11 次引用
- LLM-REDIAL: A Large-Scale Dataset for Conversational Recommender Systems Created from User Behaviors with LLMsTingting Liang, Chenxin Jin, Lingzhi Wang, Wenqi Fan 等ACL Findings 2024 · 18 次引用
- MuseChat: A Conversational Music Recommendation System for VideosZhikang Dong, Xiulong Liu, Bin Chen, Pawel Polak 等CVPR 2024
- Harnessing Multimodal Large Language Models for Multimodal Sequential RecommendationYuyang Ye, Zhi Zheng, Yishan Shen, Tianshu Wang 等AAAI 2025 · 68 次引用
- SCREEN: A Benchmark for Situated Conversational RecommendationDongding Lin, Jian Wang, Chak Tou Leong, Wenjie LiACM MM 2024 · 3 次引用
