Understanding the Potentials and Limitations of Prompt-based Music Generative AI
Youjin Choi, JaeYoung Moon, Jinyoung Yoo, Jin-Hyuk Hong
Abstract
Prompt-based music generative artificial intelligence (GenAI) offers an efficient way to engage in music creation through language. However, it faces limitations in conveying artistic intent with language alone, highlighting the need for more research on AI-creator interactions. This study evaluates three different interaction modes (prompt-based, preset-based, and motif-based) of commercialized music AI toots with 17 participants of varying musical expertise to examine how prompt-based GenAI can improve creative intention. Our findings revealed that user groups preferred prompt-based music GenAI for distinct purposes: experts used it to validate musical concepts, novices to generate reference samples, and nonprofessionals to transform abstract ideas into musical compositions. We identified its potential for enhancing compositional efficiency and creativity through intuitive interaction, while also noting limitations in handling temporal and musical nuances solely through prompts. Based on these insights, we present design guidelines to ensure users can effectively engage in the creative process, considering their musical expertise.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Cited by top-tier papers3
- MusicScaffold: Bridging Machine Efficiency and Human Growth in Adolescent Creative Education through Generative AIZhejing Hu, Yan Liu, Zhi Zhang, Gong Chen et al.CHI 2026 · 2 citations
- From Daily Song to Daily Self: Supporting Emotional Growth of Deaf and Hard-of-Hearing Individuals through Generative AI SongwritingYoujin Choi, Jinyoung Yoo, JaeYoung Moon, Yoonjae Kim et al.CHI 2026 · 2 citations
- SoundStager: Interactive Design of Story-Driven GenAI Soundscapes for VideoSuhyeon Yoo, Adolfo Hernandez Santisteban, Prem Seetharaman, Justin Salamon et al.CHI 2026 · 2 citations
Related papers
- MVPrompt: Building Music-Visual Prompts for AI Artists to Craft Music Video Mise-en-scèneChungHa Lee, Daeho Lee, Jin-Hyuk HongCHI 2025 · 5 citations
- Exploring the Potential of Music Generative AI for Music-Making by Deaf and Hard of Hearing PeopleYoujin Choi, JaeYoung Moon, Jinyoung Yoo, Jin-Hyuk HongCHI 2025 · 15 citations
- When Teams Embrace AI: Human Collaboration Strategies in Generative Prompting in a Creative Design TaskYuanning Han, Ziyi Qiu, Jiale Cheng, Ray LCCHI 2024 · 103 citations
- Why Johnny Can't Prompt: How Non-AI Experts Try (and Fail) to Design LLM PromptsJ. D. Zamfirescu-Pereira, Richmond Y. Wong, Bjoern Hartmann, Qian YangCHI 2023 · 892 citations
- Sound Designer-Generative AI Interactions: Towards Designing Creative Support Tools for Professional Sound DesignersPurnima Kamath, Fabio Morreale, Priambudi Lintang Bagaskara, Yize Wei et al.CHI 2024 · 36 citations
