Phoneme-Aware Adaptation with Discrepancy Minimization and Dynamically-Classified Vector for Text-independent Speaker Verification
Jia Wang, Tianhao Lan, Jie Chen, Chengwen Luo, Chao Wu, Jianqiang Li
Abstract
Recent studies show that introducing phonetic information into multi-task learning could significantly improve the performance of speaker embedding extraction. However, benefits of such architectures usually depend largely on the availibility of a well-matched dataset, and domain or language mismatch would result in obvious dropdown in performance. Meanwhile, the utilization of these massive mismatched data and application of these auxiliary tasks may bring many rich features that could be exploited. In this paper, we propose a phoneme-aware adaptation network with discrepancy minimization and dynamically-classified vector for text-independent speaker verification to address these abovementioned challenges. More specifically, our method first utilize the maximum mean discrepancy (MMD) as part of the total loss function to solve the mismatch between training data of the speaker subnet and the phoneme subnet. And then we use a dynamically-classified vector-guided softmax loss (DV-Softmax), which could adaptively emphasize different high-quality features and dynamically change their weights, to guide the discriminative speaker embedding. Experimental results on VoxCeleb1 data set confirmed its superiority against the other state-of-the-art phoneme adaptation methods, providing approximately 15% relative improvements in equal error rate (EER).
Ask Lune
Know where this paper stands in minutes, not an afternoon.
Lune can read the top-tier papers that cite it and the ones closest to it, and tells you what it claims, what came after and where it falls short, each point cited to the paper it comes from. No skimming, no AI slop.
Related papers
- Cross-Modal Distillation for Speaker RecognitionYufeng Jin, Guosheng Hu, Haonan Chen, Duoqian Miao et al.AAAI 2023 · 21 citations
- Unsupervised Domain Adaptation Integrating Transformer and Mutual Information for Cross-Corpus Speech Emotion RecognitionShiqing Zhang, Ruixin Liu, Yijiao Yang, Xiaoming Zhao et al.ACM MM 2022 · 19 citations
- Mix-DANN and Dynamic-Modal-Distillation for Video Domain AdaptationYuehao Yin, Bin Zhu, Jingjing Chen, Lechao Cheng et al.ACM MM 2022 · 7 citations
- Self-Supervised Disentangled Representation Learning for Robust Target Speech ExtractionZhaoxi Mu, Xinyu Yang, Sining Sun, Qing YangAAAI 2024 · 13 citations
- JDMAN: Joint Discriminative and Mutual Adaptation Networks for Cross-Domain Facial Expression RecognitionYingjian Li, Yingnan Gao, Bingzhi Chen, Zheng Zhang et al.ACM MM 2021 · 21 citations
