PSST: Enabling Blind or Visually Impaired Developers to Author Sonifications of Streaming Sensor Data
Venkatesh Potluri, John Thompson, James Devine, Bongshin Lee, Nora Morsi, Peli de Halleux, Steve Hodges, Jennifer Mankoff
Abstract
We present the first toolkit that equips blind and visually impaired (BVI) developers with the tools to create accessible data displays. Called PSST (Physical computing Streaming Sensor data Toolkit), it enables BVI developers to understand the data generated by sensors from a mouse to a micro:bit physical computing platform. By assuming visual abilities, earlier efforts to make physical computing accessible fail to address the need for BVI developers to access sensor data. PSST enables BVI developers to understand real-time, real-world sensor data by providing control over what should be displayed, as well as when to display and how to display sensor data. PSST supports filtering based on raw or calculated values, highlighting, and transformation of data. Output formats include tonal sonification, nonspeech audio files, speech, and SVGs for laser cutting. We validate PSST through a series of demonstrations and a user study with BVI developers.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5d1bf9cf-21d7-40ab-940e-36c0a2075a04Cited by top-tier papers4
- Umwelt: Accessible Structured Editing of Multi-Modal Data RepresentationsJonathan Zong, Isabella Pedraza Pineros, Mengzhu Katie Chen, Daniel Hajas et al.CHI 2024 · 17 citations
- ProgramAlly: Creating Custom Visual Access Programs via Multi-Modal End-User ProgrammingJaylin Herskovitz, Andi Xu, Rahaf Alharbi, Anhong GuoUIST 2024 · 8 citations
- Wordplay: Accessible, Multilingual, Interactive TypographyAmy J. Ko, Carlos Aldana Lira, Isabel AmayaCHI 2025 · 2 citations
- Perceiving Slope and Acceleration: Evidence for Variable Tempo Sampling in Pitch-Based Sonification of FunctionsDanyang Fan, Walker Smith, Takako Fujioka, Chris Chafe et al.IEEE VIS 2025
Builds on5
- Anticipate and Adjust: Cultivating Access in Human-Centered MethodsKelly Mack, Emma McDonnell, Venkatesh Potluri, Maggie Xu et al.CHI 2022 · 80 citations
- Infosonics: Accessible Infographics for People who are Blind using Sonification and VoiceLeona M. Holloway, Cagatay Goncu, Alon Ilsar, Matthew Butler et al.CHI 2022 · 55 citations
- Understanding Accessibility and Collaboration in Programming for People with Visual ImpairmentsMaulishree Pandey, Vaishnav Kameswaran, Hrishikesh V. Rao, Sile O'Modhrain et al.CSCW 2021 · 53 citations
- TangibleCircuits: An Interactive 3D Printed Circuit Education Tool for People with Visual ImpairmentsJosh Urban Davis, Te-Yen Wu, Bo Shi, Hanyi Lu et al.CHI 2020 · 32 citations
- "It's Just Everything Outside of the IDE that's the Problem": : Information Seeking by Software Developers with Visual ImpairmentsKevin M. Storer, Harini Sampath, M. Alice MerrickCHI 2021 · 25 citations
Related papers
- AccessibleCircuits: Adaptive Add-On Circuit Components for People with Blindness or Low VisionRuei-Che Chang, Wen-Ping Wang, Chi-Huan Chiang, Te-Yen Wu et al.CHI 2021 · 18 citations
- Three Modalities, Two Design Probes, One Prototype, and No Vision: Experience-Based Co-Design of a Multi-modal 3D Data Visualization ToolSanchita S. Kamath, Aziz N. Zeidieh, Venkatesh Potluri, Sile O'Modhrain et al.CHI 2026
- I-Scratch: Independent Slide Creation With Auditory Comment and Haptic Interface for the Blind and Visually ImpairedGyeongdeok Kim, Chungman Lim, Gunhyuk ParkCHI 2025 · 8 citations
- Spatial Audio-Enhanced Multimodal Graph Rendering for Efficient Data Trend Learning on Touchscreen DevicesWilfredo Joshua Robinson Moore, Medhani Kalal, Jennifer L. Tennison, Nicholas A. Giudice et al.CHI 2024 · 4 citations
- IncluSim: An Accessible Educational Electronic Circuit Simulator for Blind and Low-Vision LearnersAya Mouallem, Mirelys Mendez Pons, Ali Malik, Trini Rogando et al.CHI 2025 · 3 citations
