Infosonics: Accessible Infographics for People who are Blind using Sonification and Voice
Leona M. Holloway, Cagatay Goncu, Alon Ilsar, Matthew Butler, Kim Marriott
Abstract
Data visualisations are increasingly used online to engage readers and enable independent analysis of the data underlying news stories. However, access to such infographics is problematic for readers who are blind or have low vision (BLV). Equitable access to information is a basic human right and essential for independence and inclusion. We introduce infosonics, the audio equivalent of infographics, as a new style of interactive sonification that uses a spoken introduction and annotation, non-speech audio and sound design elements to present data in an understandable and engaging way. A controlled user evaluation with 18 BLV adults found a COVID-19 infosonic enabled a clearer mental image than a traditional sonification. Further, infosonics prove complementary to text descriptions and facilitate independent understanding of the data. Based on our findings, we provide preliminary suggestions for infosonics design, which we hope will enable BLV people to gain equitable access to online news and information.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ed48fbd2-b7ca-4b21-ad1d-bed182c4edc1Cited by top-tier papers14
- Chart Reader: Accessible Visualization Experiences Designed with Screen Reader UsersJohn R. Thompson, Jesse J. Martinez, Alper Sarikaya, Edward Cutrell et al.CHI 2023 · 43 citations
- Making Short-Form Videos Accessible with Hierarchical Video SummariesTess Van Daele, Akhil Iyer, Yuning Zhang, Jalyn C. Derry et al.CHI 2024 · 37 citations
- Accessible Data Representation with Natural SoundMd. Naimul Hoque, Md Ehtesham-Ul-Haque, Niklas Elmqvist, Syed Masum BillahCHI 2023 · 31 citations
- PSST: Enabling Blind or Visually Impaired Developers to Author Sonifications of Streaming Sensor DataVenkatesh Potluri, John Thompson, James Devine, Bongshin Lee et al.UIST 2022 · 25 citations
- When Refreshable Tactile Displays Meet Conversational Agents: Investigating Accessible Data Presentation and Analysis with Touch and SpeechSamuel Reinders, Matthew Butler, Ingrid Zukerman, Bongshin Lee et al.IEEE VIS 2024 · 24 citations
Builds on1
Related papers
- Supporting Accessible Data Visualization Through Audio Data NarrativesAlexa F. Siu, Gene S.-H. Kim, Sile O'Modhrain, Sean FollmerCHI 2022 · 63 citations
- Sonification of Emotion in Social Media: Affect and Accessibility in Facebook ReactionsStanley J. Cantrell, R. Michael Winters, Prakriti Kaini, Bruce N. WalkerCSCW 2022 · 5 citations
- Towards Understanding Sensory Substitution for Accessible Visualization: An Interview StudyPramod Chundury, Biswaksen Patnaik, Yasmin Reyazuddin, Christine Tang et al.IEEE VIS 2021 · 57 citations
- Spatial Audio-Enhanced Multimodal Graph Rendering for Efficient Data Trend Learning on Touchscreen DevicesWilfredo Joshua Robinson Moore, Medhani Kalal, Jennifer L. Tennison, Nicholas A. Giudice et al.CHI 2024 · 4 citations
- Auditory Display in Interactive Science Simulations: Description and Sonification Support Interaction and Enhance Opportunities for LearningBrianna J. Tomlinson, Bruce N. Walker, Emily B. MooreCHI 2020 · 26 citations
