Designing a Generative AI-Assisted Music Psychotherapy Tool for Deaf and Hard-of-Hearing Individuals
Youjin Choi, JaeYoung Moon, Jinyoung Yoo, Jennifer G. Kim, Jin-Hyuk Hong
Abstract
Songwriting has long served as a powerful medium for expressing unconscious emotions and fostering self-awareness in psychotherapy. Due to the auditory-centric nature of traditional approaches, Deaf and Hard-of-Hearing (DHH) individuals have often been excluded from music's therapeutic benefits. In response, this study presents a music psychotherapy tool co-designed with therapists, integrating conversational agents (CAs) and music generative AI as symbolic and therapeutic media. Through a usage study with 23 DHH individuals, we found that collaborative songwriting with the CA enabled them to experience emotional release, reinterpretation, and deeper self-understanding. In particular, the CA's strategies-supportive empathy, example response options, and visualbased metaphors-were found to facilitate musical dialogue effectively for DHH individuals. These findings contribute to inclusive AI design by showing the potential of human-AI collaboration to bridge therapeutic and artistic practices.
• Human-centered computing → Empirical studies in HCI; Accessibility systems and tools; Collaborative and social computing systems and tools.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on17
- "I Hear You, I Feel You": Encouraging Deep Self-disclosure through a ChatbotYi-Chieh Lee, Naomi Yamashita, Yun Huang, Wai FuCHI 2020 · 333 citations
- MindfulDiary: Harnessing Large Language Model to Support Psychiatric Patients' JournalingTaewan Kim, Seolyeong Bae, Hyun Ah Kim, Su-Woo Lee et al.CHI 2024 · 112 citations
- Unlock Life with a Chat(GPT): Integrating Conversational AI with Large Language Models into Everyday Lives of Autistic IndividualsDasom Choi, Sunok Lee, Sung-In Kim, Kyungah Lee et al.CHI 2024 · 78 citations
- ChaCha: Leveraging Large Language Models to Prompt Children to Share Their Emotions about Personal EventsWoosuk Seo, Chanmo Yang, Young-Ho KimCHI 2024 · 65 citations
- Exploring the Design of Generative AI in Supporting Music-based Reminiscence for Older AdultsYucheng Jin, Wanling Cai, Li Chen, Yizhe Zhang et al.CHI 2024 · 63 citations
Related papers
- Exploring the Potential of Music Generative AI for Music-Making by Deaf and Hard of Hearing PeopleYoujin Choi, JaeYoung Moon, Jinyoung Yoo, Jin-Hyuk HongCHI 2025 · 15 citations
- From Daily Song to Daily Self: Supporting Emotional Growth of Deaf and Hard-of-Hearing Individuals through Generative AI SongwritingYoujin Choi, Jinyoung Yoo, JaeYoung Moon, Yoonjae Kim et al.CHI 2026 · 2 citations
- Understanding Human-AI Collaboration in Music Therapy Through Co-Design with TherapistsJingjing Sun, Jingyi Yang, Guyue Zhou, Yucheng Jin et al.CHI 2024 · 31 citations
- Novice-AI Music Co-Creation via AI-Steering Tools for Deep Generative ModelsRyan Louie, Andy Coenen, Cheng Zhi Huang, Michael Terry et al.CHI 2020 · 265 citations
- Exploring the Impact of AI-powered Creativity Support Tools on Professional Creative WorkflowsCaterina Moruzzi, Charlotte Bird, Laura Mariah HermanCSCW 2026
