Like, Comment & Caption: A Decade of Social Media Video Caption Research (2015-2025)
Huong Nguyen, Emma J. McDonnell, Lloyd May, Alexander Druzenko, Zoobia Saifullah Syeda, Mark Cartwright, Sooyeon Lee
Abstract
As video has become the dominant mode of content on platforms such as YouTube, TikTok, and Instagram, captioning has emerged as a critical factor for accessibility, engagement, and visibility. While prior studies have examined different types of social media video captions or communities' captioning usage, a systematic synthesis has not been undertaken, leading to the risk of proposing interventions that overlook core platform constraints or miss critical accessibility needs. This paper reviews 36 peer-reviewed papers published between 2015 and 2025 across fields such as Human-Computer Interaction (HCI), accessibility, media studies, education, and language learning. We note that captions operate as collective infrastructure co-produced by viewers, creators, and platforms. Deaf and Hard of Hearing (DHH), neurodivergent, and multilingual viewers depend on captions and increasingly expect mechanisms for feedback, while creators face inadequate tool support. Building on these insights, we propose the framework of Participatory Captioning and suggest design implications, highlighting future directions for social media video caption research.
• Human-centered computing → Accessibility systems and tools; HCI design and evaluation methods; Empirical studies in HCI ; Social media.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext effd4201-0e26-4e67-90bd-37ce44fb7112Builds on22
- A Literature Review of Video-Sharing Platform Research in HCIAva Bartolome, Shuo NiuCHI 2023 · 63 citations
- "Hey, Can You Add Captions?": The Critical Infrastructuring Practices of Neurodiverse People on TikTokEllen Simpson, Samantha Dalal, Bryan C. SemaanCSCW 2023 · 52 citations
- Social App Accessibility for Deaf SignersKelly Mack, Danielle Bragg, Meredith Ringel Morris, Maarten W. Bos et al.CSCW 2020 · 52 citations
- Social, Environmental, and Technical: Factors at Play in the Current Use and Future Design of Small-Group CaptioningEmma J. McDonnell, Ping Liu, Steven M. Goodman, Raja S. Kushalnagar et al.CSCW 2021 · 50 citations
- Visualization of Speech Prosody and Emotion in Captions: Accessibility for Deaf and Hard-of-Hearing UsersCaluã de Lacerda Pataca, Matthew Watkins, Roshan L. Peiris, Sooyeon Lee et al.CHI 2023 · 39 citations
Related papers
- "Voices Help Correlate Signs and Words": Analyzing Deaf and Hard-of-Hearing (DHH) TikTokers' Content, Practices, and PitfallsJiaxun Cao, Xuening Peng, Fan Liang, Xin TongCHI 2024 · 12 citations
- "Caption It in an Accessible Way That Is Also Enjoyable": Characterizing User-Driven Captioning Practices on TikTokEmma J. McDonnell, Tessa Eagle, Pitch Sinlapanuntakul, Soo Hyun Moon et al.CHI 2024 · 33 citations
- "Easier or Harder, Depending on Who the Hearing Person Is": Codesigning Videoconferencing Tools for Small Groups with Mixed Hearing StatusEmma J. McDonnell, Soo Hyun Moon, Lucy Jiang, Steven M. Goodman et al.CHI 2023 · 26 citations
- Haptic-Captioning: Using Audio-Haptic Interfaces to Enhance Speaker Indication in Real-Time Captions for Deaf and Hard-of-Hearing ViewersYiwen Wang, Ziming Li, Pratheep Kumar Chelladurai, Wendy Dannels et al.CHI 2023 · 32 citations
- An Exploration of Captioning Practices and Challenges of Individual Content Creators on YouTube for People with Hearing ImpairmentsFranklin Mingzhe Li, Cheng Lu, Zhicong Lu, Patrick Carrington et al.CSCW 2022 · 34 citations
