A Sequential Self Teaching Approach for Improving Generalization in Sound Event Recognition
Anurag Kumar, Vamsi K. Ithapu
Abstract
An important problem in machine auditory perception is to recognize and detect sound events. In this paper, we propose a sequential self-teaching approach to learning sounds. Our main proposition is that it is harder to learn sounds in adverse situations such as from weakly labeled and/or noisy labeled data, and in these situations a single stage of learning is not sufficient. Our proposal is a sequential stage-wise learning process that improves generalization capabilities of a given modeling system. We justify this method via technical results and on Audioset, the largest sound events dataset, our sequential learning approach can lead to up to 9% improvement in performance. A comprehensive evaluation also shows that the method leads to improved transferability of knowledge from previously trained models, thereby leading to improved generalization capabilities on transfer learning tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itRelated papers
- Zero-Shot Audio Source Separation through Query-Based Learning from Weakly-Labeled DataKe Chen, Xingjian Du, Bilei Zhu, Zejun Ma et al.AAAI 2022 · 58 citations
- BirdSet: A Large-Scale Dataset for Audio Classification in Avian BioacousticsLukas Rauch, Raphael Schwinger, Moritz Wirth, René Heinrich et al.ICLR 2025
- Contrastive Audio-Visual Masked AutoencoderYuan Gong, Andrew Rouditchenko, Alexander H. Liu, David Harwath et al.ICLR 2023 · 17 citations
- Enhanced Audio Tagging via Multi- to Single-Modal Teacher-Student Mutual LearningYifang Yin, Harsh Shrivastava, Ying Zhang, Zhenguang Liu et al.AAAI 2021 · 18 citations
- Modality-Independent Teachers Meet Weakly-Supervised Audio-Visual Event ParserYung-Hsuan Lai, Yen-Chun Chen, Frank WangNeurIPS 2023 · 27 citations
