"Explain What a Treemap is": Exploratory Investigation of Strategies for Explaining Unfamiliar Chart to Blind and Low Vision Users
Gyeongri Kim, Jiho Kim, Yea-Seul Kim
Abstract
Visualization designers increasingly use diverse types of visualizations, but assistive technologies and education for blind and low vision people often focus on elementary chart types. We explore textual explanation as a more generalizable solution. We define three dimensions of explanation strategies based on education theories: comparing to a familiar chart type, describing how to draw one, and using a concrete example. We develop a prototype system that automatically generates text explanations from a given chart specification. We conduct an exploratory study with 24 legally blind people to observe both the effectiveness and the perceived effectiveness of the strategies. The findings include: description of visual appearance is overall more effective than instructions for drawing, effective strategies differ by each chart type and by each participant, and the user’s perceived effectiveness does not always lead to better performance. We demonstrate the feasibility of an explanation generation system and compile design considerations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers5
- TADA: Making Node-link Diagrams Accessible to Blind and Low-Vision PeopleYichun Zhao, Miguel A. Nacenta, Mahadeo A. Sukhai, Sowmya SomanathCHI 2024 · 21 citations
- Designing Unobtrusive Modulated Electrotactile Feedback on Fingertip Edge to Assist Blind and Low Vision (BLV) People in Comprehending ChartsChutian Jiang, Yinan Fan, Junan Xie, Emily Kuang et al.CHI 2024 · 20 citations
- Learnable and Expressive Visualization Authoring Through Blended InterfacesSehi L'Yi, Astrid van den Brandt, Etowah Adams, Huyen N. Nguyen et al.IEEE VIS 2024 · 6 citations
- How Do Low-Vision Individuals Experience Information Visualization?Yanan Wang, Yuhang Zhao, Yea-Seul KimCHI 2024 · 5 citations
- Using Tactile Charts to Support Comprehension and Learning of Complex Visualizations for Blind and Low-Vision IndividualsTingying He, Maggie K. McCracken, Daniel Hajas, Sarah H. Creem-Regehr et al.IEEE VIS 2025 · 3 citations
Builds on4
- Accessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic ContentAlan Lundgard, Arvind SatyanarayanIEEE VIS 2021 · 141 citations
- Visualization Accessibility in the Wild: Challenges Faced by Visualization DesignersShakila Cherise S. Joyner, Amalia Riegelhuth, Kathleen Garrity, Yea-Seul Kim et al.CHI 2022 · 42 citations
- Tactile Presentation of Network Data: Text, Matrix or Diagram?Yalong Yang, Kim Marriott, Matthew Butler, Cagatay Goncu et al.CHI 2020 · 24 citations
- Communicating Visualizations without Visuals: Investigation of Visualization Alternative Text for People with Visual ImpairmentsCrescentia Jung, Shubham Mehta, Atharva Kulkarni, Yuhang Zhao et al.IEEE VIS 2021 · 2 citations
Related papers
- Chart Reader: Accessible Visualization Experiences Designed with Screen Reader UsersJohn R. Thompson, Jesse J. Martinez, Alper Sarikaya, Edward Cutrell et al.CHI 2023 · 43 citations
- Exploring Chart Question Answering for Blind and Low Vision UsersJiho Kim, Arjun Srinivasan, Nam Wook Kim, Yea-Seul KimCHI 2023 · 33 citations
- From Vision to Touch: Bridging Visual and Tactile Principles for Accessible Data RepresentationKim Marriott, Matthew Butler, Leona Holloway, William Jolley et al.IEEE VIS 2025 · 3 citations
- "They Aren't Built for Me": An Exploratory Study of Strategies for Measurement of Graphical Primitives in Tactile GraphicsAreen Khalaila, Lane Harrison, Nam Wook Kim, Dylan CashmanIEEE VIS 2025 · 2 citations
- Nonvisual Support for Understanding and Reasoning about Data StructuresBrianna L. Wimer, Ritesh Kanchi, Kaija Frierson, Venkatesh Potluri et al.CHI 2026 · 2 citations
