SPECTRA: Personalizable Sound Recognition for Deaf and Hard of Hearing Users through Interactive Machine Learning
Steven M. Goodman, Emma J. McDonnell, Jon E. Froehlich, Leah Findlater
Abstract
Record soundsTrain personalized model Iteratively test Figure 1: Overview of the SPECTRA pipeline.In an interactive machine learning training workfow, users collect audio data samples (left), flter their data into a training dataset (center), and assess their model's performance in a live environment (right).The design includes key elements to support the needs of DHH users during this process, including spectrogram and waveform audio visualizations of audio, data annotating to save useful contextual information, and an interactive clustering visualization of their dataset.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f440c9df-bb35-4caf-904f-42288a4dcb64Cited by top-tier papers1
Ask how each one uses itBuilds on8
- Understanding and Visualizing Data Iteration in Machine LearningFred Hohman, Kanit Wongsuphasawat, Mary Beth Kery, Kayur PatelCHI 2020 · 114 citations
- Whither AutoML? Understanding the Role of Automation in Machine Learning WorkflowsDoris Xin, Eva Yiwei Wu, Doris Jung Lin Lee, Niloufar Salehi et al.CHI 2021 · 103 citations
- HomeSound: An Iterative Field Deployment of an In-Home Sound Awareness System for Deaf or Hard of Hearing UsersDhruv Jain, Kelly Mack, Akli Amrous, Matt Wright et al.CHI 2020 · 52 citations
- ProtoSound: A Personalized and Scalable Sound Recognition System for Deaf and Hard-of-Hearing UsersDhruv Jain, Khoa Huynh Anh Nguyen, Steven M. Goodman, Rachel Grossman-Kahn et al.CHI 2022 · 45 citations
- Marcelle: Composing Interactive Machine Learning Workflows and InterfacesJules Françoise, Baptiste Caramiaux, Téo SanchezUIST 2021 · 37 citations
Related papers
- Toward User-Driven Sound Recognizer Personalization with People Who Are d/Deaf or Hard of HearingSteven Goodman, Ping Liu, Dhruv Jain, Emma J. McDonnell et al.UbiComp 2021 · 33 citations
- PASA: Progressive-Adaptive Spectral Augmentation for Automated Auscultation in Data-Scarce EnvironmentsYing Wang, Guoheng Huang, Xueyuan Gong, Xinxin Wang et al.AAAI 2026
- Online Community-based Design of Free and Open Source Software for Transgender Voice TrainingAlex A. Ahmed, Bryan Kok, Coranna Howard, Klew StillCSCW 2020 · 30 citations
- Visually Informed Binaural Audio Generation without Binaural AudiosXudong Xu, Hang Zhou, Ziwei Liu, Bo Dai et al.CVPR 2021
- Towards Personalized Physiotherapy through Interactive Machine Learning: A Conceptual Infrastructure Design for In-Clinic and Out-of-Clinic SupportLaia Turmo Vidal, Annika Waern, Rosa Cabanas-Valdés, Lauren van Loo et al.CHI 2025 · 2 citations
