Not Seeing the Whole Picture: Challenges and Opportunities in Using AI for Co-Making Physical, DIY-AT for People with Visual Impairments
Ben Kosa, Hsuanling Lee, Jasmine Li, Sanbrita Mondal, Yuhang Zhao, Liang He
摘要
Existing assistive technologies (AT) often adopt a one-size-fits-all approach, overlooking the diverse needs of people with visual impairments (PVI). Do-it-yourself AT (DIY-AT) toolkits offer one path toward customization, but most remain limited—targeting co-design with engineers or requiring programming expertise. Non-professionals with disabilities, including PVI, also face barriers such as inaccessible tools, lack of confidence, and insufficient technical knowledge. These gaps highlight the need for prototyping technologies that enable PVI to directly make their own AT. Building on emerging evidence that large language models (LLMs) can serve not only as visual aids but also as co-design partners, we present an exploratory study of how LLM-based AI can support PVI in the tangible DIY-AT co-making process. Our findings surface key challenges and design opportunities: the need for greater spatial and visual support, strategies for mitigating novel AI errors, and implications for designing more accessible AI-assisted prototypes.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper15
- FashionQ: An AI-Driven Creativity Support Tool for Facilitating Ideation in Fashion DesignYoungseung Jeon, Seungwan Jin, Patrick C. Shih, Kyungsik HanCHI 2021 · 被引用 143 次
- Understanding Nonlinear Collaboration between Human and AI Agents: A Co-design Framework for Creative DesignJiayi Zhou, Renzhong Li, Junxiu Tang, Tan Tang 等CHI 2024 · 被引用 100 次
- The Effectiveness of Visual and Audio Wayfinding Guidance on Smartglasses for People with Low VisionYuhang Zhao, Elizabeth Kupferstein, Hathaitorn Rojnirun, Leah Findlater 等CHI 2020 · 被引用 89 次
- SpatialLM: Training Large Language Models for Structured Indoor ModelingYongsen Mao, Junhao Zhong, Chuan Fang, Jia Zheng 等NeurIPS 2025 · 被引用 89 次
- "It Felt Like Having a Second Mind": Investigating Human-AI Co-creativity in Prewriting with Large Language ModelsQian Wan, Siying Hu, Yu Zhang, Piaohong Wang 等CSCW 2024 · 被引用 86 次
相关 Paper
- Understanding the Use of a Large Language Model-Powered Guide to Make Virtual Reality Accessible for Blind and Low Vision PeopleJazmin Collins, Sharon Y. Lin, Tianqi Liu, Andrea Stevenson Won 等CHI 2026 · 被引用 3 次
- AXNav: Replaying Accessibility Tests from Natural LanguageMaryam Taeb, Amanda Swearngin, Eldon Schoop, Ruijia Cheng 等CHI 2024 · 被引用 51 次
- How Multimodal Large Language Models Support Access to Visual Information: A Diary Study With Blind and Low Vision PeopleRicardo E. Gonzalez Penuela, Crescentia Jung, Sharon Y. Lin, Ruiying Hu 等CHI 2026 · 被引用 1 次
- Towards LLM-powered Assistive Drone for Blind and Low Vision UsersYize Wei, Ibnu Taimiyyah Bin Adam, Hanjun Wu, Moritz Messerschmidt 等CHI 2026 · 被引用 1 次
- Lost in Instructions: Study of Blind Users' Experiences with DIY Manuals and AI-Rewritten Instructions for Assembly, Operation, and Troubleshooting of Tangible ProductsMonalika Padma Reddy, Aruna Balasubramanian, Jiawei Zhou, Xiaojun Bi 等CHI 2026 · 被引用 1 次
