Learning under Temporal Label Noise
Sujay Nagaraj, Walter Gerych, Sana Tonekaboni, Anna Goldenberg, Berk Ustun, Thomas Hartvigsen
Abstract
Many time series classification tasks, where labels vary over time, are affected by label noise that also varies over time. Such noise can cause label quality to improve, worsen, or periodically change over time. We first propose and formalize temporal label noise, an unstudied problem for sequential classification of time series. In this setting, multiple labels are recorded over time while being corrupted by a time-dependent noise function. We first demonstrate the importance of modeling the temporal nature of the label noise function and how existing methods will consistently underperform. We then propose methods to train noise-tolerant classifiers by estimating the temporal label noise function directly from data. We show that our methods lead to state-of-the-art performance under diverse types of temporal label noise on real-world datasets. 1 Published as a conference paper at ICLR 2025 Noise Time 0 Recon Err Temporal Ignore Noise True Static Accur Temporal Ignore Noise True Static 0 50 * Noise Rate % Time True Noise Static Methods Temporal Methods Ignore Noise 50 0 Standard supervised learning ignores label noise. Existing methods assume noise is static ignoring its temporal nature Accurately modelling the true temporal noise function, allows us to learn noise-tolerant classifiers * Best Performing * * * *
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on16
- Symmetric Cross Entropy for Robust Learning With Noisy LabelsYisen Wang, Xingjun Ma, Zaiyi Chen, Yuan Luo et al.ICCV 2019 · 1,125 citations
- Unified Training of Universal Time Series Forecasting TransformersGerald Woo, Chenghao Liu, Akshat Kumar, Caiming Xiong et al.ICML 2024 · 513 citations
- Learning with Noisy Labels Revisited: A Study Using Real-World Human AnnotationsJiaheng Wei, Zhaowei Zhu, Hao Cheng, Tongliang Liu et al.ICLR 2022 · 338 citations
- Dual T: Reducing Estimation Error for Transition Matrix in Label-noise LearningYu Yao, Tongliang Liu, Bo Han, Mingming Gong et al.NeurIPS 2020 · 297 citations
- Peer Loss Functions: Learning from Noisy Labels without Knowing Noise RatesYang Liu, Hongyi GuoICML 2020 · 280 citations
Related papers
- Learning with Feature-Dependent Label Noise: A Progressive ApproachYikai Zhang, Songzhu Zheng, Pengxiang Wu, Mayank Goswami et al.ICLR 2021 · 184 citations
- Estimating Instance-dependent Bayes-label Transition Matrix using a Deep Neural NetworkShuo Yang, Erkun Yang, Bo Han, Yang Liu et al.ICML 2022 · 59 citations
- Tackling Instance-Dependent Label Noise with Dynamic Distribution CalibrationManyi Zhang, Yuxin Ren, Zihao Wang, Chun YuanACM MM 2022 · 6 citations
- Estimating Noise Transition Matrix with Label Correlations for Noisy Multi-Label LearningShikun Li, Xiaobo Xia, Hansong Zhang, Yibing Zhan et al.NeurIPS 2022 · 95 citations
- Learning Noise Transition Matrix from Only Noisy Labels via Total Variation RegularizationYivan Zhang, Gang Niu, Masashi SugiyamaICML 2021 · 107 citations
