Branch Explorer: Leveraging Branching Narratives to Support Interactive 360° Video Viewing for Blind and Low Vision Users
Shuchang Xu, Xiaofu Jin, Wenshuo Zhang, Huamin Qu, Yukang Yan
Abstract
Figure 1: Branch Explorer transforms 360° videos into branching narratives-stories that dynamically unfold based on viewer choices-to create an engaging experience for blind and low vision (BLV) users.It employs a multi-modal machine learning pipeline to generate diverse narrative paths, enabling BLV users to make choices at key branching points and explore each storyline through immersive audio guidance.The figure shows the 360° video HELP (available at: https://youtu.be/G-XZhKqQAHU).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6e4ab197-5119-4857-8271-a1d5b17aee54Cited by top-tier papers1
Ask how each one uses itBuilds on28
- BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsJunnan Li, Dongxu Li, Silvio Savarese, Steven C. H. HoiICML 2023 · 7,873 citations
- TransReID: Transformer-based Object Re-IdentificationShuting He, Hao Luo, Pichao Wang, Fan Wang et al.ICCV 2021 · 1,172 citations
- Virtual Reality Without Vision: A Haptic and Auditory White Cane to Navigate Complex Virtual WorldsAlexa F. Siu, Mike Sinclair, Robert Kovacs, Eyal Ofek et al.CHI 2020 · 115 citations
- Toward Automatic Audio Description Generation for Accessible VideosYujia Wang, Wei Liang, Haikun Huang, Yongqi Zhang et al.CHI 2021 · 86 citations
- Rescribe: Authoring and Automatically Editing Audio DescriptionsAmy Pavel, Gabriel Reyes, Jeffrey P. BighamUIST 2020 · 72 citations
Related papers
- From Selfie Stick to Virtual Cane: Enabling Blind Exploration through Mobile Virtual RealityHao Tang, Hong Zhao, Xinpeng Liu, Zhenchao Xia et al.CHI 2026
- SPICA: Interactive Video Content Exploration through Augmented Audio Descriptions for Blind or Low-Vision ViewersZheng Ning, Brianna L. Wimer, Kaiwen Jiang, Keyi Chen et al.CHI 2024 · 27 citations
- OmniScribe: Authoring Immersive Audio Descriptions for 360° VideosRuei-Che Chang, Chao-Hsien Ting, Chia-Sheng Hung, Wan-Chen Lee et al.UIST 2022 · 32 citations
- "Hey Model!" - Natural User Interactions and Agency in Accessible Interactive 3D ModelsSamuel Reinders, Matthew Butler, Kim MarriottCHI 2020 · 22 citations
- Fast-forwarding, Rewinding, and Path Exploration in Interactive Branched Video StreamingAlbin Vogel, Erik Kronberg, Niklas CarlssonACM MM 2021 · 1 citation
