Perceiving Slope and Acceleration: Evidence for Variable Tempo Sampling in Pitch-Based Sonification of Functions
Danyang Fan, Walker Smith, Takako Fujioka, Chris Chafe, Sile O'Modhrain, Diana Deutsch, Sean Follmer
摘要
Sonification offers a non-visual way to understand data, with pitch-based encodings being the most common. Yet, how well people perceive slope and acceleration-key features of data trends-remains poorly understood. Drawing on people's natural abilities to perceive tempo, we introduce a novel sampling method for pitch-based sonification to enhance the perception of slope and acceleration in univariate functions. While traditional sonification methods often sample data at uniform x-spacing, yielding notes played at a fixed tempo with variable pitch intervals (Variable Pitch Interval), our approach samples at uniform y-spacing, producing notes with consistent pitch intervals but variable tempo (Variable Tempo). We conducted psychoacoustic experiments to understand slope and acceleration perception across three sampling methods: Variable Pitch Interval, Variable Tempo, and a Continuous (no sampling) baseline. In slope comparison tasks, Variable Tempo was more accurate than the other methods when modulated by the magnitude ratio between slopes. For acceleration perception, just-noticeable differences under Variable Tempo were over 13 times finer than with other methods. Participants also commonly reported higher confidence, lower mental effort, and a stronger preference for Variable Tempo compared to other methods. This work contributes models of slope and acceleration perception across pitch-based sonification techniques, introduces Variable Tempo as a novel and preferred sampling method, and provides promising initial evidence that leveraging timing can lead to more sensitive, accurate, and precise interpretation of derivative-based data features.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper3
- Slide-Tone and Tilt-Tone: 1-DOF Haptic Techniques for Conveying Shape Characteristics of Graphs to Blind UsersDanyang Fan, Alexa Fay Siu, Wing-Sum Adrienne Law, Raymond Ruihong Zhen 等CHI 2022 · 被引用 36 次
- PSST: Enabling Blind or Visually Impaired Developers to Author Sonifications of Streaming Sensor DataVenkatesh Potluri, John Thompson, James Devine, Bongshin Lee 等UIST 2022 · 被引用 25 次
- TactualPlot: Spatializing Data as Sound Using Sensory Substitution for Touchscreen AccessibilityPramod Chundury, Yasmin Reyazuddin, J. Bern Jordan, Jonathan Lazar 等IEEE VIS 2023 · 被引用 21 次
相关 Paper
- Spatial Audio-Enhanced Multimodal Graph Rendering for Efficient Data Trend Learning on Touchscreen DevicesWilfredo Joshua Robinson Moore, Medhani Kalal, Jennifer L. Tennison, Nicholas A. Giudice 等CHI 2024 · 被引用 4 次
- Exploring Audio Interfaces for Vertical Guidance in Augmented Reality via Hand-Based FeedbackRenan Guarese, Emma Pretty, Aidan Renata, Deb Polson 等IEEE VR 2024 · 被引用 10 次
- Visualising Pianists' Touch: Transcribing Expressive Piano Performance from Audio to Piano Key MotionJingjing Tang, Shinichi Furuya, Hayato Nishioka, Momoko Shioki 等CHI 2026 · 被引用 1 次
- Erie: A Declarative Grammar for Data SonificationHyeok Kim, Yea-Seul Kim, Jessica HullmanCHI 2024 · 被引用 11 次
- Exploring Auditory Information to Change Users' Perception of Time Passing as ShorterTakanori Komatsu, Seiji YamadaCHI 2020 · 被引用 15 次
