Lune

ACL Findings2025

MUSE: A Multimodal Conversational Recommendation Dataset with Scenario-Grounded User Profiles

Zihan Wang, Xiaocui Yang, Yongkang Liu, Shi Feng, Daling Wang, Yifei Zhang

Abstract

Current conversational recommendation systems focus predominantly on text. However, real-world recommendation settings are generally multimodal, causing a significant gap between existing research and practical applications. To address this issue, we propose Muse, the first multimodal conversational recommendation dataset. Muse comprises 83,148 utterances from 7,000 conversations centered around the Clothing domain. Each conversation contains comprehensive multimodal interactions, rich elements, and natural dialogues. Data in Muse are automatically synthesized by a multi-agent framework powered by multimodal large language models (MLLMs). It innovatively derives user profiles from real-world scenarios rather than depending on manual design and history data for better scalability, and then it fulfills conversation simulation and optimization. Both human and LLM evaluations demonstrate the high quality of conversations in Muse. Additionally, fine-tuning experiments on three MLLMs demonstrate Muse's learnable patterns for recommendations and responses, confirming its value for multimodal conversational recommendation. Our dataset and codes are available at https://anonymous.4open.science/r/Muse-0086.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 3 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers3

  1. LettinGo: Explore User Profile Generation for Recommendation SystemLu Wang, Di Zhang, Fangkai Yang, Pu Zhao et al.KDD 2025 · 2 citations
  2. Where and What: Reasoning Dynamic and Implicit Preferences in Situated Conversational RecommendationDongding Lin, Jian Wang, Yongqi Li, Wenjie LiACL 2026
  3. HARPO: Hierarchical Agentic Reasoning for User-Aligned Conversational RecommendationSubham Raj, Aman Vaibhav Jha, Mayank Anand, Sriparna SahaACL 2026

Builds on17

  1. LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
  2. M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge DistillationJianlyu Chen, Shitao Xiao, Peitian Zhang, Kun Luo et al.ACL Findings 2024 · 762 citations
  3. Self-Instruct: Aligning Language Models with Self-Generated InstructionsYizhong Wang, Yeganeh Kordi, Swaroop Mishra, Alisa Liu et al.ACL 2023 · 540 citations
  4. Bridging Language and Items for Retrieval and Recommendation: Benchmarking LLMs as Semantic EncodersYupeng Hou, Jiacheng Li, Xiangjun Fu, Zhankui He et al.ACL 2026 · 346 citations
  5. Towards Conversational Recommendation over Multi-Type DialogsZeming Liu, Haifeng Wang, Zheng-Yu Niu, Hua Wu et al.ACL 2020 · 157 citations

Related papers

  1. Pearl: A Review-driven Persona-Knowledge Grounded Conversational Recommendation DatasetMinjin Kim, Minju Kim, Hana Kim, Beong-woo Kwak et al.ACL Findings 2024 · 11 citations
  2. LLM-REDIAL: A Large-Scale Dataset for Conversational Recommender Systems Created from User Behaviors with LLMsTingting Liang, Chenxin Jin, Lingzhi Wang, Wenqi Fan et al.ACL Findings 2024 · 18 citations
  3. MuseChat: A Conversational Music Recommendation System for VideosZhikang Dong, Xiulong Liu, Bin Chen, Pawel Polak et al.CVPR 2024
  4. Harnessing Multimodal Large Language Models for Multimodal Sequential RecommendationYuyang Ye, Zhi Zheng, Yishan Shen, Tianshu Wang et al.AAAI 2025 · 68 citations
  5. SCREEN: A Benchmark for Situated Conversational RecommendationDongding Lin, Jian Wang, Chak Tou Leong, Wenjie LiACM MM 2024 · 3 citations
Dusk over the sea between two cliffs drawn in fine vertical lines