Perceiving Slope and Acceleration: Evidence for Variable Tempo Sampling in Pitch-Based Sonification of Functions
Danyang Fan, Walker Smith, Takako Fujioka, Chris Chafe, Sile O'Modhrain, Diana Deutsch, Sean Follmer
Abstract
Sonification offers a non-visual way to understand data, with pitch-based encodings being the most common. Yet, how well people perceive slope and acceleration-key features of data trends-remains poorly understood. Drawing on people's natural abilities to perceive tempo, we introduce a novel sampling method for pitch-based sonification to enhance the perception of slope and acceleration in univariate functions. While traditional sonification methods often sample data at uniform x-spacing, yielding notes played at a fixed tempo with variable pitch intervals (Variable Pitch Interval), our approach samples at uniform y-spacing, producing notes with consistent pitch intervals but variable tempo (Variable Tempo). We conducted psychoacoustic experiments to understand slope and acceleration perception across three sampling methods: Variable Pitch Interval, Variable Tempo, and a Continuous (no sampling) baseline. In slope comparison tasks, Variable Tempo was more accurate than the other methods when modulated by the magnitude ratio between slopes. For acceleration perception, just-noticeable differences under Variable Tempo were over 13 times finer than with other methods. Participants also commonly reported higher confidence, lower mental effort, and a stronger preference for Variable Tempo compared to other methods. This work contributes models of slope and acceleration perception across pitch-based sonification techniques, introduces Variable Tempo as a novel and preferred sampling method, and provides promising initial evidence that leveraging timing can lead to more sensitive, accurate, and precise interpretation of derivative-based data features.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cb1df458-d6c9-4e6c-8919-34ac7c2b7697Builds on3
- Slide-Tone and Tilt-Tone: 1-DOF Haptic Techniques for Conveying Shape Characteristics of Graphs to Blind UsersDanyang Fan, Alexa Fay Siu, Wing-Sum Adrienne Law, Raymond Ruihong Zhen et al.CHI 2022 · 36 citations
- PSST: Enabling Blind or Visually Impaired Developers to Author Sonifications of Streaming Sensor DataVenkatesh Potluri, John Thompson, James Devine, Bongshin Lee et al.UIST 2022 · 25 citations
- TactualPlot: Spatializing Data as Sound Using Sensory Substitution for Touchscreen AccessibilityPramod Chundury, Yasmin Reyazuddin, J. Bern Jordan, Jonathan Lazar et al.IEEE VIS 2023 · 21 citations
Related papers
- Spatial Audio-Enhanced Multimodal Graph Rendering for Efficient Data Trend Learning on Touchscreen DevicesWilfredo Joshua Robinson Moore, Medhani Kalal, Jennifer L. Tennison, Nicholas A. Giudice et al.CHI 2024 · 4 citations
- Exploring Audio Interfaces for Vertical Guidance in Augmented Reality via Hand-Based FeedbackRenan Guarese, Emma Pretty, Aidan Renata, Deb Polson et al.IEEE VR 2024 · 10 citations
- Visualising Pianists' Touch: Transcribing Expressive Piano Performance from Audio to Piano Key MotionJingjing Tang, Shinichi Furuya, Hayato Nishioka, Momoko Shioki et al.CHI 2026 · 1 citation
- Erie: A Declarative Grammar for Data SonificationHyeok Kim, Yea-Seul Kim, Jessica HullmanCHI 2024 · 11 citations
- Exploring Auditory Information to Change Users' Perception of Time Passing as ShorterTakanori Komatsu, Seiji YamadaCHI 2020 · 15 citations
