"Easier or Harder, Depending on Who the Hearing Person Is": Codesigning Videoconferencing Tools for Small Groups with Mixed Hearing Status
Emma J. McDonnell, Soo Hyun Moon, Lucy Jiang, Steven M. Goodman, Raja S. Kushalnagar, Jon E. Froehlich, Leah Findlater
Abstract
With improvements in automated speech recognition and increased use of videoconferencing, real-time captioning has changed significantly. This shift toward broadly available but less accurate captioning invites exploration of the role hearing conversation partners play in shaping the accessibility of a conversation to d/Deaf and hard of hearing (DHH) captioning users. While recent work has explored DHH individuals’ videoconferencing experiences with captioning, we focus on established groups’ current practices and priorities for future tools to support more accessible online conversations. Our study consists of three codesign sessions, conducted with four groups (17 participants total, 10 DHH, 7 hearing). We found that established groups crafted social accessibility norms that met their relational contexts. We also identify promising directions for future captioning design, including the need to standardize speaker identification and customization, opportunities to provide behavioral feedback during a conversation, and ways that videoconferencing platforms could enable groups to set and share norms.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 140b56dc-6bd3-4894-be23-930d9f53a3c7Cited by top-tier papers9
- Exploring Positionality in HCI: Perspectives, Trends, and ChallengesAneesha Singh, Martin Johannes Dechant, Dilisha Patel, Ewan Soubutts et al.CHI 2025 · 42 citations
- "Caption It in an Accessible Way That Is Also Enjoyable": Characterizing User-Driven Captioning Practices on TikTokEmma J. McDonnell, Tessa Eagle, Pitch Sinlapanuntakul, Soo Hyun Moon et al.CHI 2024 · 33 citations
- Semantic Hearing: Programming Acoustic Scenes with Binaural HearablesBandhav Veluri, Malek Itani, Justin Chan, Takuya Yoshioka et al.UIST 2023 · 29 citations
- COMPA: Using Conversation Context to Achieve Common Ground in AACStephanie Valencia, Jessica Huynh, Emma Y. Jiang, Yufei Wu et al.CHI 2024 · 20 citations
- "That comes with a huge career cost:" Understanding Collaborative Ideation Experiences of Disabled ProfessionalsMaitraye Das, Abigale Stangl, Leah FindlaterCSCW 2024 · 11 citations
Builds on11
- Eliciting Tech Futures Among Black Young Adults: A Case Study of Remote Speculative Co-DesignChristina N. Harrington, Tawanna R. DillahuntCHI 2021 · 171 citations
- Understanding the Telework Experience of People with DisabilitiesJohn C. TangCSCW 2021 · 107 citations
- Anticipate and Adjust: Cultivating Access in Human-Centered MethodsKelly Mack, Emma McDonnell, Venkatesh Potluri, Maggie Xu et al.CHI 2022 · 80 citations
- Remotely Co-Designing Features for Communication Applications using Automatic Captioning with Deaf and Hearing PairsMatthew Seita, Sooyeon Lee, Sarah Andrew, Kristen Shinohara et al.CHI 2022 · 51 citations
- Social, Environmental, and Technical: Factors at Play in the Current Use and Future Design of Small-Group CaptioningEmma J. McDonnell, Ping Liu, Steven M. Goodman, Raja S. Kushalnagar et al.CSCW 2021 · 50 citations
Related papers
- Understanding and Enhancing The Role of Speechreading in Online d/DHH Communication AccessibilityAashaka Desai, Jennifer Mankoff, Richard E. LadnerCHI 2023 · 9 citations
- Visualization of Speech Prosody and Emotion in Captions: Accessibility for Deaf and Hard-of-Hearing UsersCaluã de Lacerda Pataca, Matthew Watkins, Roshan L. Peiris, Sooyeon Lee et al.CHI 2023 · 39 citations
- "In this online environment, we're limited": : Exploring Inclusive Video Conferencing Design for SignersJazz Rui Xia Ang, Ping Liu, Emma McDonnell, Sarah CoppolaCHI 2022 · 41 citations
- Haptic-Captioning: Using Audio-Haptic Interfaces to Enhance Speaker Indication in Real-Time Captions for Deaf and Hard-of-Hearing ViewersYiwen Wang, Ziming Li, Pratheep Kumar Chelladurai, Wendy Dannels et al.CHI 2023 · 32 citations
- Sparkling Silence: Practices and Challenges of Livestreaming Among Deaf or Hard of Hearing StreamersBeiyan Cao, Changyang He, Muzhi Zhou, Mingming FanCHI 2023 · 12 citations
