MAIDR: Making Statistical Visualizations Accessible with Multimodal Data Representation
Jooyoung Seo, Yilin Xia, Bongshin Lee, Sean McCurry, Yu Jun Yam
Abstract
This paper investigates new data exploration experiences that enable blind users to interact with statistical data visualizations—bar plots, heat maps, box plots, and scatter plots—leveraging multimodal data representations. In addition to sonification and textual descriptions that are commonly employed by existing accessible visualizations, our MAIDR (multimodal access and interactive data representation) system incorporates two additional modalities (braille and review) that offer complementary benefits. It also provides blind users with the autonomy and control to interactively access and understand data visualizations. In a user study involving 11 blind participants, we found the MAIDR system facilitated the accurate interpretation of statistical visualizations. Participants exhibited a range of strategies in combining multiple modalities, influenced by their past interactions and experiences with data visualizations. This work accentuates the overlooked potential of combining refreshable tactile representation with other modalities and elevates the discussion on the importance of user autonomy when designing accessible data visualizations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e157be8a-d207-474e-9aae-feee048f553eCited by top-tier papers11
- VizAbility: Enhancing Chart Accessibility with LLM-based Conversational InteractionJoshua Gorniak, Yoon Kim, Donglai Wei, Nam Wook KimUIST 2024 · 32 citations
- When Refreshable Tactile Displays Meet Conversational Agents: Investigating Accessible Data Presentation and Analysis with Touch and SpeechSamuel Reinders, Matthew Butler, Ingrid Zukerman, Bongshin Lee et al.IEEE VIS 2024 · 24 citations
- Tactile Vega-Lite: Rapidly Prototyping Tactile Charts with Smart DefaultsMengzhu Katie Chen, Isabella Pedraza Pineros, Arvind Satyanarayan, Jonathan ZongCHI 2025 · 10 citations
- MisVisFix: An Interactive Dashboard for Detecting, Explaining, and Correcting Misleading Visualizations using Large Language ModelsAmit Kumar Das, Klaus MuellerIEEE VIS 2025 · 5 citations
- From Vision to Touch: Bridging Visual and Tactile Principles for Accessible Data RepresentationKim Marriott, Matthew Butler, Leona Holloway, William Jolley et al.IEEE VIS 2025 · 3 citations
Builds on10
- Accessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic ContentAlan Lundgard, Arvind SatyanarayanIEEE VIS 2021 · 141 citations
- Answering Questions about Charts and Generating Visual ExplanationsDae Hyun Kim, Enamul Hoque, Maneesh AgrawalaCHI 2020 · 121 citations
- VoxLens: Making Online Data Visualizations Accessible with an Interactive JavaScript Plug-InAther Sharif, Olivia H. Wang, Alida T. Muongchan, Katharina Reinecke et al.CHI 2022 · 88 citations
- Supporting Accessible Data Visualization Through Audio Data NarrativesAlexa F. Siu, Gene S.-H. Kim, Sile O'Modhrain, Sean FollmerCHI 2022 · 63 citations
- Chart Reader: Accessible Visualization Experiences Designed with Screen Reader UsersJohn R. Thompson, Jesse J. Martinez, Alper Sarikaya, Edward Cutrell et al.CHI 2023 · 43 citations
Related papers
- Spatial Audio-Enhanced Multimodal Graph Rendering for Efficient Data Trend Learning on Touchscreen DevicesWilfredo Joshua Robinson Moore, Medhani Kalal, Jennifer L. Tennison, Nicholas A. Giudice et al.CHI 2024 · 4 citations
- Towards Understanding Sensory Substitution for Accessible Visualization: An Interview StudyPramod Chundury, Biswaksen Patnaik, Yasmin Reyazuddin, Christine Tang et al.IEEE VIS 2021 · 57 citations
- Three Modalities, Two Design Probes, One Prototype, and No Vision: Experience-Based Co-Design of a Multi-modal 3D Data Visualization ToolSanchita S. Kamath, Aziz N. Zeidieh, Venkatesh Potluri, Sile O'Modhrain et al.CHI 2026
- TactualPlot: Spatializing Data as Sound Using Sensory Substitution for Touchscreen AccessibilityPramod Chundury, Yasmin Reyazuddin, J. Bern Jordan, Jonathan Lazar et al.IEEE VIS 2023 · 21 citations
- Using Tactile Charts to Support Comprehension and Learning of Complex Visualizations for Blind and Low-Vision IndividualsTingying He, Maggie K. McCracken, Daniel Hajas, Sarah H. Creem-Regehr et al.IEEE VIS 2025 · 3 citations
