Label-Noise Robust Domain Adaptation
Xiyu Yu, Tongliang Liu, Mingming Gong, Kun Zhang, Kayhan Batmanghelich, Dacheng Tao
Abstract
Domain adaptation aims to correct the classifiers when faced with distribution shift between source (training) and target (test) domains. State-of-theart domain adaptation methods make use of deep networks to extract domain-invariant representations. However, existing methods assume that all the instances in the source domain are correctly labeled; while in reality, it is unsurprising that we may obtain a source domain with noisy labels. In this paper, we are the first to comprehensively investigate how label noise could adversely affect existing domain adaptation methods in various scenarios. Further, we theoretically prove that there exists a method that can essentially reduce the side-effect of noisy source labels in domain adaptation. Specifically, focusing on the generalized target shift scenario, where both label distribution P Y and the class-conditional distribution P X|Y can change, we discover that the denoising Conditional Invariant Component (DCIC) framework can provably ensures (1) extracting invariant representations given examples with noisy labels in the source domain and unlabeled examples in the target domain and (2) estimating the label distribution in the target domain with no bias. Experimental results on both synthetic and realworld data verify the effectiveness of the proposed method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers11
- Part-dependent Label Noise: Towards Instance-dependent Label NoiseXiaobo Xia, Tongliang Liu, Bo Han, Nannan Wang et al.NeurIPS 2020 · 329 citations
- Learning with Bounded Instance and Label-dependent Label NoiseJiacheng Cheng, Tongliang Liu, Kotagiri Ramamohanarao, Dacheng TaoICML 2020 · 162 citations
- Provably End-to-end Label-noise Learning without Anchor PointsXuefeng Li, Tongliang Liu, Bo Han, Gang Niu et al.ICML 2021 · 161 citations
- Maximum Mean Discrepancy Test is Aware of Adversarial AttacksRuize Gao, Feng Liu, Jingfeng Zhang, Bo Han et al.ICML 2021 · 77 citations
- Class2Simi: A Noise Reduction Perspective on Learning with Noisy LabelsSonghua Wu, Xiaobo Xia, Tongliang Liu, Bo Han et al.ICML 2021 · 59 citations
Builds on5
- SELF: Learning to Filter Noisy Labels with Self-EnsemblingDuc Tam Nguyen, Chaithanya Kumar Mummadi, Thi-Phuong-Nhung Ngo, Thi Hoai Phuong Nguyen et al.ICLR 2020 · 354 citations
- Peer Loss Functions: Learning from Noisy Labels without Knowing Noise RatesYang Liu, Hongyi GuoICML 2020 · 280 citations
- Learning with Bounded Instance and Label-dependent Label NoiseJiacheng Cheng, Tongliang Liu, Kotagiri Ramamohanarao, Dacheng TaoICML 2020 · 162 citations
- Unbiased Risk Estimators Can Mislead: A Case Study of Learning with Complementary LabelsYu-Ting Chou, Gang Niu, Hsuan-Tien Lin, Masashi SugiyamaICML 2020 · 66 citations
- LTF: A Label Transformation Framework for Correcting Label ShiftJiaxian Guo, Mingming Gong, Tongliang Liu, Kun Zhang et al.ICML 2020 · 43 citations
Related papers
- Noise-Robust Learning from Multiple Unsupervised Sources of Inferred LabelsAmila Silva, Ling Luo, Shanika Karunasekera, Christopher LeckieAAAI 2022 · 11 citations
- Tackling Instance-Dependent Label Noise with Dynamic Distribution CalibrationManyi Zhang, Yuxin Ren, Zihao Wang, Chun YuanACM MM 2022 · 6 citations
- Divergence Optimization for Noisy Universal Domain AdaptationQing Yu, Atsushi Hashimoto, Yoshitaka UshikuCVPR 2021
- IDEAL: High-Order-Ensemble Adaptation Network for Learning with Noisy LabelsPeng-Fei Zhang, Zi Huang, Guangdong Bai, Xin-Shun XuACM MM 2022 · 3 citations
- DAT: Training Deep Networks Robust To Label-Noise by Matching the Feature DistributionsYuntao Qu, Shasha Mo, Jianwei NiuCVPR 2021
