Toward Language Justice: Exploring Multilingual Captioning for Accessibility
Aashaka Desai, Rahaf Alharbi, Stacy Hsueh, Richard E. Ladner, Jennifer Mankoff
Abstract
A growing body of research investigates how to make captioning experiences more accessible and enjoyable to disabled people. However, prior work has focused largely on English captioning, neglecting the majority of people who are multilingual (i.e., understand or express themselves in more than one language). To address this gap, we conducted semi-structured interviews and diary logs with 13 participants who used multilingual captions for accessibility. Our findings highlight the linguistic and cultural dimensions of captioning, detailing how language features (scripts and orthography) and the inclusion/negation of cultural context shape the accessibility of captions. Despite lack of quality and availability, participants emphasized the importance of multilingual captioning to learn a new language, build community, and preserve cultural heritage. Moving toward a future where all ways of communicating are celebrated, we present ways to orient captioning research to a language justice agenda that decenters English and engages with varied levels of fluency.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a27cf56e-6c05-4600-8e6e-7a839fa751feCited by top-tier papers4
- Reimagining Sign Language Technologies: Analyzing Translation Work of Chinese Deaf Online Content CreatorsXinru Tang, Anne Marie PiperCHI 2026 · 2 citations
- Beyond the Manual: Mapping Peer-Generated Content about Wheelchair Care and Adaptation on YouTubeWen Mo, Aneesha Singh, Lan Xiao, Catherine HollowayCHI 2026 · 1 citation
- Lost in Transcription: Subtitle Errors in Automatic Speech Recognition Reduce Speaker and Content EvaluationsKowe Kadoma, Priyal Shrivastava, Mor NaamanCHI 2026 · 1 citation
- Like, Comment & Caption: A Decade of Social Media Video Caption Research (2015-2025)Huong Nguyen, Emma J. McDonnell, Lloyd May, Alexander Druzenko et al.CHI 2026 · 1 citation
Builds on19
- Robust Speech Recognition via Large-Scale Weak SupervisionAlec Radford, Jong Wook Kim, Tao Xu, Greg Brockman et al.ICML 2023 · 6,966 citations
- What Do We Mean by "Accessibility Research"?: A Literature Survey of Accessibility Papers in CHI and ASSETS from 1994 to 2019Kelly Mack, Emma McDonnell, Dhruv Jain, Lucy Lu Wang et al.CHI 2021 · 323 citations
- Towards Accessible Remote Work: Understanding Work-from-Home Practices of Neurodivergent ProfessionalsMaitraye Das, John C. Tang, Kathryn E. Ringland, Anne Marie PiperCSCW 2021 · 133 citations
- Anticipate and Adjust: Cultivating Access in Human-Centered MethodsKelly Mack, Emma McDonnell, Venkatesh Potluri, Maggie Xu et al.CHI 2022 · 80 citations
- "It's the only thing I can trust": Envisioning Large Language Model Use by Autistic Workers for Communication AssistanceJiWoong Jang, Sanika Moharana, Patrick Carrington, Andrew BegelCHI 2024 · 58 citations
Related papers
- "Easier or Harder, Depending on Who the Hearing Person Is": Codesigning Videoconferencing Tools for Small Groups with Mixed Hearing StatusEmma J. McDonnell, Soo Hyun Moon, Lucy Jiang, Steven M. Goodman et al.CHI 2023 · 26 citations
- Social, Environmental, and Technical: Factors at Play in the Current Use and Future Design of Small-Group CaptioningEmma J. McDonnell, Ping Liu, Steven M. Goodman, Raja S. Kushalnagar et al.CSCW 2021 · 50 citations
- Social App Accessibility for Deaf SignersKelly Mack, Danielle Bragg, Meredith Ringel Morris, Maarten W. Bos et al.CSCW 2020 · 52 citations
- Sparkling Silence: Practices and Challenges of Livestreaming Among Deaf or Hard of Hearing StreamersBeiyan Cao, Changyang He, Muzhi Zhou, Mingming FanCHI 2023 · 12 citations
- Visualization of Speech Prosody and Emotion in Captions: Accessibility for Deaf and Hard-of-Hearing UsersCaluã de Lacerda Pataca, Matthew Watkins, Roshan L. Peiris, Sooyeon Lee et al.CHI 2023 · 39 citations
