Adaptive Learning for Weakly Labeled Streams
Zhen-Yu Zhang, Yu-Yang Qian, Yu-Jie Zhang, Yuan Jiang, Zhi-Hua Zhou
Abstract
In plenty of real-world applications, data are collected in a streaming fashion, and their accurate labels are hard to obtain. For instance, in the environmental monitoring task, sensors are collecting the data all the time. Still, their labels are scarce because the labeling process requires human effort and can conceal annotation errors. This paper investigates the problem of learning with weakly labeled data streams, in which data are continuously collected, and only a limited subset of streaming data is labeled but potentially with noise. This setting is challenging and of great importance but rarely studied in the literature. When the data are constantly gathered with unknown noise on labels, it is quite challenging to design algorithms to obtain a well-generalized classifier. To address this difficulty, we propose a novel noise transition matrix estimation approach for data streams with scarce noisy labels by online anchor points identification. Based on that, we propose an adaptive learning algorithm for weakly labeled data streams via model reuse and effectively alleviate the negative influence of label noise with unlabeled data. Both theoretical analysis and extensive experiments justify and validate the effectiveness of the proposed approach.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on5
- DivideMix: Learning with Noisy Labels as Semi-supervised LearningJunnan Li, Richard Socher, Steven C. H. HoiICLR 2020 · 1,326 citations
- Learning with Bounded Instance and Label-dependent Label NoiseJiacheng Cheng, Tongliang Liu, Kotagiri Ramamohanarao, Dacheng TaoICML 2020 · 162 citations
- Dynamic Regret of Convex and Smooth FunctionsPeng Zhao, Yu-Jie Zhang, Lijun Zhang, Zhi-Hua ZhouNeurIPS 2020 · 136 citations
- Learning with Feature and Distribution Evolvable StreamsZhenyu Zhang, Peng Zhao, Yuan Jiang, Zhi-Hua ZhouICML 2020 · 48 citations
- Exploratory Machine Learning with Unknown UnknownsPeng Zhao, Yu-Jie Zhang, Zhi-Hua ZhouAAAI 2021 · 29 citations
Related papers
- Provably End-to-end Label-noise Learning without Anchor PointsXuefeng Li, Tongliang Liu, Bo Han, Gang Niu et al.ICML 2021 · 161 citations
- Test-time Adaptation in Non-stationary Environments via Adaptive Representation AlignmentZhen-Yu Zhang, Zhiyu Xie, Huaxiu Yao, Masashi SugiyamaNeurIPS 2024 · 12 citations
- Learning Noise Transition Matrix from Only Noisy Labels via Total Variation RegularizationYivan Zhang, Gang Niu, Masashi SugiyamaICML 2021 · 107 citations
- Estimating Instance-dependent Bayes-label Transition Matrix using a Deep Neural NetworkShuo Yang, Erkun Yang, Bo Han, Yang Liu et al.ICML 2022 · 59 citations
- Semi-Supervised Streaming Learning with Emerging New LabelsYong-Nan Zhu, Yufeng LiAAAI 2020 · 31 citations
