DanmuA11y: Making Time-Synced On-Screen Video Comments (Danmu) Accessible to Blind and Low Vision Users via Multi-Viewer Audio Discussions
Shuchang Xu, Xiaofu Jin, Huamin Qu, Yukang Yan
Abstract
By overlaying time-synced user comments on videos, Danmu creates a co-watching experience for online viewers. However, its visual-centric design poses significant challenges for blind and low vision (BLV) viewers. Our formative study identified three primary challenges that hinder BLV viewers' engagement with Danmu: the lack of visual context, the speech interference between comments and videos, and the disorganization of comments. To address these challenges, we present DanmuA11y, a system that makes Danmu accessible by transforming it into multi-viewer audio discussions. DanmuA11y incorporates three core features: (1) Augmenting Danmu with visual context, (2) Seamlessly integrating Danmu into videos, and (3) Presenting Danmu via multi-viewer discussions. Evaluation with twelve BLV viewers demonstrated that DanmuA11y significantly improved Danmu comprehension, provided smooth viewing experiences, and fostered social connections among viewers. We further highlight implications for enhancing commentary accessibility in video-based social media and live-streaming platforms.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f3effc78-1d24-49aa-8fc3-929a73ff35cfCited by top-tier papers7
- Vid2Coach: Transforming How-To Videos into Task AssistantsMina Huh, Zihui Xue, Ujjaini Das, Kumar Ashutosh et al.UIST 2025 · 9 citations
- Branch Explorer: Leveraging Branching Narratives to Support Interactive 360° Video Viewing for Blind and Low Vision UsersShuchang Xu, Xiaofu Jin, Wenshuo Zhang, Huamin Qu et al.UIST 2025 · 4 citations
- "I'm Constantly Getting Comments Like, 'Oh, You're Blind. You're Like the Only Woman That I Stand a Chance With.'": A Study of Blind TikTokers' Intersectional Experiences of Gender and SexualityYao Lyu, Jessica Shen, Alina Faisal, John M. CarrollCHI 2026 · 1 citation
- ComVi: Context-Aware Optimized Comment Display in Video PlaybackMinsun Kim, Dawon Lee, Junyong NohCHI 2026 · 1 citation
- Lost in Instructions: Study of Blind Users' Experiences with DIY Manuals and AI-Rewritten Instructions for Assembly, Operation, and Troubleshooting of Tangible ProductsMonalika Padma Reddy, Aruna Balasubramanian, Jiawei Zhou, Xiaojun Bi et al.CHI 2026 · 1 citation
Builds on41
- Generative Agents: Interactive Simulacra of Human BehaviorJoon Sung Park, Joseph C. O'Brien, Carrie Jun Cai, Meredith Ringel Morris et al.UIST 2023 · 1,882 citations
- Simple and Controllable Music GenerationJade Copet, Felix Kreuk, Itai Gat, Tal Remez et al.NeurIPS 2023 · 843 citations
- Visual Saliency TransformerNian Liu, Ni Zhang, Kaiyuan Wan, Ling Shao et al.ICCV 2021 · 473 citations
- Twitter A11y: A Browser Extension to Make Twitter Images AccessibleCole Gleason, Amy Pavel, Emma McCamey, Christina Low et al.CHI 2020 · 123 citations
- PromptCap: Prompt-Guided Image Captioning for VQA with GPT-3Yushi Hu, Hang Hua, Zhengyuan Yang, Weijia Shi et al.ICCV 2023 · 91 citations
Related papers
- Ga11y: An Automated GIF Annotation System for Visually Impaired UsersMingrui Ray Zhang, Mingyuan Zhong, Jacob O. WobbrockCHI 2022 · 24 citations
- CoKnowledge: Supporting Assimilation of Time-synced Collective Knowledge in Online Science VideosYuanhao Zhang, Yumeng Wang, Xiyuan Wang, Changyang He et al.CHI 2025 · 4 citations
- Towards Inclusive Video Commenting: Introducing Signmaku for the Deaf and Hard-of-HearingSi Chen, Haocong Cheng, Jason Situ, Desirée Kirst et al.CHI 2024 · 11 citations
- VideoIC: A Video Interactive Comments Dataset and Multimodal Multitask Learning for Comments GenerationWeiying Wang, Jieting Chen, Qin JinACM MM 2020 · 26 citations
- Cocomix: Utilizing Comments to Improve Non-Visual Webtoon AccessibilityMina Huh, Yunjung Lee, Dasom Choi, Haesoo Kim et al.CHI 2022 · 22 citations
