Accessible Data Representation with Natural Sound
Md. Naimul Hoque, Md Ehtesham-Ul-Haque, Niklas Elmqvist, Syed Masum Billah
Abstract
Sonification translates data into non-speech audio. Such auditory representations can make data visualization accessible to people who are blind or have low vision (BLV). This paper presents a sonification method for translating common data visualization into a blend of natural sounds. We hypothesize that people's familiarity with sounds drawn from nature, such as birds singing in a forest, and their ability to listen to these sounds in parallel, will enable BLV users to perceive multiple data points being sonified at the same CHI '23, April 23-28, 2023, Hamburg, Germany Md Naimul Hoque, Md Ehtesham-Ul-Haque, Niklas Elmqvist, and Syed Masum Billah time. Informed by an extensive literature review and a preliminary study with 5 BLV participants, we designed an accessible data representation tool, Susurrus, that combines our sonification method with other accessibility features, such as keyboard interaction and text-to-speech feedback. Finally, we conducted a user study with 12 BLV participants and report the potential and application of natural sounds for sonification compared to existing sonification tools.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 70b3094a-ecc8-47a1-ac16-47877643ca44Cited by top-tier papers7
- Erie: A Declarative Grammar for Data SonificationHyeok Kim, Yea-Seul Kim, Jessica HullmanCHI 2024 · 11 citations
- Towards Enhancing Low Vision Usability of Data Charts on SmartphonesYash Prakash, Pathan Aseef Khan, Akshay Kolgar Nayak, Sampath Jayarathna et al.IEEE VIS 2024 · 6 citations
- Sensing Movement: Contemporary Dance Workshops with People who are Blind or have Low Vision and Dance TeachersMadhuka Thisuri De Silva, Jim Smiley, Sarah Goodwin, Leona M. Holloway et al.CHI 2025 · 4 citations
- Using Tactile Charts to Support Comprehension and Learning of Complex Visualizations for Blind and Low-Vision IndividualsTingying He, Maggie K. McCracken, Daniel Hajas, Sarah H. Creem-Regehr et al.IEEE VIS 2025 · 3 citations
- TapNav: Adaptive Spatiotactile Screen Readers for Tactually Guided Touchscreen Interactions for Blind and Low Vision PeopleRicardo E. Gonzalez Penuela, Fannie Liu, Blair MacIntyre, David SaffoUbiComp 2026 · 2 citations
Builds on10
- NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language QueriesArpit Narechania, Arjun Srinivasan, John T. StaskoIEEE VIS 2020 · 210 citations
- Accessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic ContentAlan Lundgard, Arvind SatyanarayanIEEE VIS 2021 · 141 citations
- VoxLens: Making Online Data Visualizations Accessible with an Interactive JavaScript Plug-InAther Sharif, Olivia H. Wang, Alida T. Muongchan, Katharina Reinecke et al.CHI 2022 · 88 citations
- Supporting Accessible Data Visualization Through Audio Data NarrativesAlexa F. Siu, Gene S.-H. Kim, Sile O'Modhrain, Sean FollmerCHI 2022 · 63 citations
- Towards Understanding Sensory Substitution for Accessible Visualization: An Interview StudyPramod Chundury, Biswaksen Patnaik, Yasmin Reyazuddin, Christine Tang et al.IEEE VIS 2021 · 57 citations
Related papers
- Infosonics: Accessible Infographics for People who are Blind using Sonification and VoiceLeona M. Holloway, Cagatay Goncu, Alon Ilsar, Matthew Butler et al.CHI 2022 · 55 citations
- Beyond Descriptions: A Generative Scene2Audio Framework for Blind and Low-Vision Users to Experience Vista LandscapesChitralekha Gupta, Jing Peng, Ashwin Ram, Shreyas Sridhar et al.CHI 2026 · 1 citation
- Three Modalities, Two Design Probes, One Prototype, and No Vision: Experience-Based Co-Design of a Multi-modal 3D Data Visualization ToolSanchita S. Kamath, Aziz N. Zeidieh, Venkatesh Potluri, Sile O'Modhrain et al.CHI 2026
- Spatial Audio-Enhanced Multimodal Graph Rendering for Efficient Data Trend Learning on Touchscreen DevicesWilfredo Joshua Robinson Moore, Medhani Kalal, Jennifer L. Tennison, Nicholas A. Giudice et al.CHI 2024 · 4 citations
- PSST: Enabling Blind or Visually Impaired Developers to Author Sonifications of Streaming Sensor DataVenkatesh Potluri, John Thompson, James Devine, Bongshin Lee et al.UIST 2022 · 25 citations
