Exploring Chart Question Answering for Blind and Low Vision Users
Jiho Kim, Arjun Srinivasan, Nam Wook Kim, Yea-Seul Kim
Abstract
Data visualizations can be complex or involve numerous data points, making them impractical to navigate using screen readers alone. Question answering (QA) systems have the potential to support visualization interpretation and exploration without overwhelming blind and low vision (BLV) users. To investigate if and how QA systems can help BLV users in working with visualizations, we conducted a Wizard of Oz study with 24 BLV people where participants freely posed queries about four visualizations. We collected 979 queries and mapped them to popular analytic task taxonomies. We found that retrieving value and finding extremum were the most common tasks, participants often made complex queries and used visual references, and the data topic notably influenced the queries. We compile a list of design considerations for accessible chart QA systems and make our question corpus publicly available to guide future research and development.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ab5adf6c-5b73-4d10-8547-3ce40095d03bCited by top-tier papers17
- VizAbility: Enhancing Chart Accessibility with LLM-based Conversational InteractionJoshua Gorniak, Yoon Kim, Donglai Wei, Nam Wook KimUIST 2024 · 32 citations
- Let's Talk Futures: A Literature Review of HCI's Future OrientationCamilo Sanchez, Sui Wang, Kaisa Savolainen, Felix Anand Epp et al.CHI 2025 · 30 citations
- MAIDR: Making Statistical Visualizations Accessible with Multimodal Data RepresentationJooyoung Seo, Yilin Xia, Bongshin Lee, Sean McCurry et al.CHI 2024 · 29 citations
- Everyday Uncertainty: How Blind People Use GenAI Tools for Information AccessXinru Tang, Ali Abdolrahmani, Darren Gergle, Anne Marie PiperCHI 2025 · 26 citations
- Data Navigator: An Accessibility-Centered Data Navigation ToolkitFrank Elavsky, Lucas Nadolskis, Dominik MoritzIEEE VIS 2023 · 25 citations
Builds on11
- NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language QueriesArpit Narechania, Arjun Srinivasan, John T. StaskoIEEE VIS 2020 · 210 citations
- Calliope: Automatic Visual Data Story Generation from a SpreadsheetDanqing Shi, Xinyue Xu, Fuling Sun, Yang Shi et al.IEEE VIS 2020 · 179 citations
- TVQA+: Spatio-Temporal Grounding for Video Question AnsweringJie Lei, Licheng Yu, Tamara L. Berg, Mohit BansalACL 2020 · 173 citations
- Accessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic ContentAlan Lundgard, Arvind SatyanarayanIEEE VIS 2021 · 141 citations
- Answering Questions about Charts and Generating Visual ExplanationsDae Hyun Kim, Enamul Hoque, Maneesh AgrawalaCHI 2020 · 121 citations
Related papers
- Chart Reader: Accessible Visualization Experiences Designed with Screen Reader UsersJohn R. Thompson, Jesse J. Martinez, Alper Sarikaya, Edward Cutrell et al.CHI 2023 · 43 citations
- When Refreshable Tactile Displays Meet Conversational Agents: Investigating Accessible Data Presentation and Analysis with Touch and SpeechSamuel Reinders, Matthew Butler, Ingrid Zukerman, Bongshin Lee et al.IEEE VIS 2024 · 24 citations
- Understanding How to Inform Blind and Low-Vision Users about Data Privacy through Privacy Question Answering AssistantsYuanyuan Feng, Abhilasha Ravichander, Yaxing Yao, Shikun Zhang et al.USENIX Security 2024 · 9 citations
- GeoVisA11y: An AI-based Geovisualization Question-Answering System for Screen-Reader UsersChu Li, Rock Yuren Pang, Arnavi Chheda-Kothary, Ather Sharif et al.CHI 2026 · 1 citation
- Three Modalities, Two Design Probes, One Prototype, and No Vision: Experience-Based Co-Design of a Multi-modal 3D Data Visualization ToolSanchita S. Kamath, Aziz N. Zeidieh, Venkatesh Potluri, Sile O'Modhrain et al.CHI 2026
