LifeInsight: Design and Evaluation of an AI-Powered Assistive Wearable for Blind and Low Vision People Across Multiple Everyday Life Scenarios
Florian Mathis, Johannes Schöning
Abstract
Assistive technologies (ATs) have the potential to empower blind and low vision (BLV) people. Yet, they often remain underutilised due to their immobility and limited applicability across scenarios. This paper presents LifeInsight, an AI-powered assistive wearable for BLV people that uses a wearable camera, microphone and single-click interface for goal-oriented visual querying. To inform the design of LifeInsight, we first collected a corpus of BLV people’s daily experiences using video probes and interviews. Ten BLV people recorded their daily experiences over one week using GoPro cameras, providing empirical insights. Based on these, we report on LifeInsight and its evaluation with 13 BLV people across six scenarios. LifeInsight effectively responded to visual queries, such as distinguishing between jars or identifying the status of a candle. Drawing on our work, we conclude with key lessons and practical recommendations to guide future research and advance the development and evaluation of AI-powered assistive wearables.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get e73ee553-1711-4782-8022-6fbeff77718eCited by top-tier papers2
- How Multimodal Large Language Models Support Access to Visual Information: A Diary Study With Blind and Low Vision PeopleRicardo E. Gonzalez Penuela, Crescentia Jung, Sharon Y. Lin, Ruiying Hu et al.CHI 2026 · 1 citation
- Towards LLM-powered Assistive Drone for Blind and Low Vision UsersYize Wei, Ibnu Taimiyyah Bin Adam, Hanjun Wu, Moritz Messerschmidt et al.CHI 2026 · 1 citation
Related papers
- LiSee: A Headphone that Provides All-day Assistance for Blind and Low-vision Users to Reach Surrounding ObjectsKaixin Chen, Yongzhi Huang, Yicong Chen, Haobin Zhong et al.UbiComp 2022 · 11 citations
- Vid2Coach: Transforming How-To Videos into Task AssistantsMina Huh, Zihui Xue, Ujjaini Das, Kumar Ashutosh et al.UIST 2025 · 9 citations
- Pedestrian Detection with Wearable Cameras for the Blind: A Two-way PerspectiveKyungjun Lee, Daisuke Sato, Saki Asakawa, Hernisa Kacorri et al.CHI 2020 · 43 citations
- Investigating Use Cases of AI-Powered Scene Description Applications for Blind and Low Vision PeopleRicardo E. Gonzalez Penuela, Jazmin Collins, Cynthia L. Bennett, Shiri AzenkotCHI 2024 · 44 citations
- Eyes on the Palm: Investigating a Ring-Shaped Camera for Seamless Accessible Tactile ExplorationAyaka Tsutsui, Xiyue Wang, Hironobu Takagi, Yoichi Ochiai et al.CHI 2026 · 1 citation
