A Contextual Inquiry of People with Vision Impairments in Cooking
Franklin Mingzhe Li, Michael Xieyang Liu, Shaun K. Kane, Patrick Carrington
Abstract
Individuals with vision impairments employ a variety of strategies for object identification, such as pans or soy sauce, in the culinary process. In addition, they often rely on contextual details about objects, such as location, orientation, and current status, to autonomously execute cooking activities. To understand how people with vision impairments collect and use the contextual information of objects while cooking, we conducted a contextual inquiry study with 12 participants in their own kitchens. This research aims to analyze object interaction dynamics in culinary practices to enhance assistive vision technologies for visually impaired cooks. We outline eight different types of contextual information and the strategies that blind cooks currently use to access the information while preparing meals. Further, we discuss preferences for communicating contextual information about kitchen objects as well as considerations for the deployment of AI-powered assistive technologies.
CCS Concepts: • Human-centered computing → Empirical studies in accessibility.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fc0f248f-17b7-4898-803c-8a68e4c32f45Cited by top-tier papers12
- CookAR: Affordance Augmentations in Wearable AR to Support Kitchen Tool Interactions for People with Low VisionJaewook Lee, Andrew D. Tjahjadi, Jiho Kim, Junpu Yu et al.UIST 2024 · 25 citations
- OmniQuery: Contextually Augmenting Captured Multimodal Memories to Enable Personal Question AnsweringJiahao Nick Li, Zhuohao Jerry Zhang, Jiaju MaCHI 2025 · 22 citations
- How Users Who are Blind or Low Vision Play Mobile Games: Perceptions, Challenges, and StrategiesZihe Ran, Xiyu Li, Qing Xiao, Xianzhe Fan et al.CHI 2025 · 9 citations
- Vid2Coach: Transforming How-To Videos into Task AssistantsMina Huh, Zihui Xue, Ujjaini Das, Kumar Ashutosh et al.UIST 2025 · 9 citations
- Human Robot Interaction for Blind and Low Vision People: A Systematic Literature ReviewYize Wei, Nathan Rocher, Chitralekha Gupta, Mia Huong Nguyen et al.CHI 2025 · 7 citations
Builds on7
- PaLM-E: An Embodied Multimodal Language ModelDanny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch et al.ICML 2023 · 2,601 citations
- Conditional Prompt Learning for Vision-Language ModelsKaiyang Zhou, Jingkang Yang, Chen Change Loy, Ziwei LiuCVPR 2022 · 1,438 citations
- Wigglite: Low-cost Information Collection and TriageMichael Xieyang Liu, Andrew Kuznetsov, Yongsung Kim, Joseph Chee Chang et al.UIST 2022 · 62 citations
- Understanding Visual Arts Experiences of Blind PeopleFranklin Mingzhe Li, Lotus Zhang, Maryam Bandukda, Abigale Stangl et al.CHI 2023 · 51 citations
- "I Choose Assistive Devices That Save My Face": A Study on Perceptions of Accessibility and Assistive Technology Use Conducted in ChinaFranklin Mingzhe Li, Di Laura Chen, Mingming Fan, Khai N. TruongCHI 2021 · 45 citations
Related papers
- AROMA: Mixed-Initiative AI Assistance for Non-Visual Cooking by Grounding Multimodal Information Between Reality and VideosZheng Ning, Leyang Li, Daniel Killough, JooYoung Seo et al.UIST 2025 · 1 citation
- Evoking empathy with visually impaired people through an augmented reality embodiment experienceRenan Guarese, Emma Pretty, Haytham M. Fayek, Fabio Zambetta et al.IEEE VR 2023 · 23 citations
- "I Don't Really Get Involved In That Way": Investigating Blind and Visually Impaired Individuals' Experiences of Joint Attention with Sighted PeopleKatherine Mary Jones, Ute Leonards, Oussama MetatlaCHI 2024 · 6 citations
- (Computer) Vision in Action: Comparing Remote Sighted Assistance and a Multimodal Voice Agent in Inspection SequencesDamien Rudaz, Barbara Nino Carreras, Sara Merlino, Brian L. Due et al.CHI 2026 · 2 citations
- "If sighted people know, I should be able to know: " Privacy Perceptions of Bystanders with Visual Impairments around Camera-based TechnologyYuhang Zhao, Yaxing Yao, Jiaru Fu, Nihan ZhouUSENIX Security 2023
