Trust-calibrated Collaborative Learning for Long-Tailed Visual Recognition
Hao Zhou, Tingjin Luo
摘要
Real-world visual recognition faces the fundamental challenge of long-tailed distributions. While state-of-the-art methods often employ multi-expert models to address different frequency categories, we find that the mutual knowledge distillation used in these models enhances collaboration at the cost of introducing two critical limitations: indiscriminate knowledge transfer leads to bias propagation, where a single expert's error can spread and contaminate others, and error consolidation, where mutual reinforcement of incorrect predictions solidifies erroneous consensus. To overcome these issues, we propose Trust-calibrated Collaborative Learning (TCL). Our framework introduces the trustworthy knowledge orchestration module, which enables reliable distillation and precise collaboration through a knowledge quality gate that blocks erroneous information and a tail-class knowledge compensation mechanism that alleviates knowledge scarcity for tail samples. Furthermore, we design a consensus error calibration module that suppresses consensus high-confidence negative classes to correct collective misjudgments and steer optimization in the right direction. Extensive experiments on five longtailed benchmarks demonstrate that TCL achieves the best performance, raising Top-1 accuracy on CIFAR100-LT to 58.7%, a gain of 1.5% over previous SOTA methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper28
- RandAugment: Practical Automated Data Augmentation with a Reduced Search SpaceEkin Dogus Cubuk, Barret Zoph, Jonathon Shlens, Quoc LeNeurIPS 2020 · 被引用 4,453 次
- Decoupling Representation and Classifier for Long-Tailed RecognitionBingyi Kang, Saining Xie, Marcus Rohrbach, Zhicheng Yan 等ICLR 2020 · 被引用 1,496 次
- Long-tail learning via logit adjustmentAditya Krishna Menon, Sadeep Jayasumana, Ankit Singh Rawat, Himanshu Jain 等ICLR 2021 · 被引用 937 次
- Balanced Meta-Softmax for Long-Tailed Visual RecognitionJiawei Ren, Cunjun Yu, Shunan Sheng, Xiao Ma 等NeurIPS 2020 · 被引用 861 次
- Long-tailed Recognition by Routing Diverse Distribution-Aware ExpertsXudong Wang, Long Lian, Zhongqi Miao, Ziwei Liu 等ICLR 2021 · 被引用 481 次
相关 Paper
- Distilling Balanced Knowledge from a Biased TeacherSeonghak KimCVPR 2026 · 被引用 1 次
- MDCS: More Diverse Experts with Consistency Self-distillation for Long-tailed RecognitionQihao Zhao, Chen Jiang, Wei Hu, Fan Zhang 等ICCV 2023 · 被引用 35 次
- Rethinking Long-tailed Dataset Distillation: A Uni-Level Framework with Unbiased Recovery and RelabelingXiao Cui, Yulei Qin, Xinyue Li, Wengang Zhou 等AAAI 2026 · 被引用 1 次
- Balanced Product of Calibrated Experts for Long-Tailed RecognitionEmanuel Sanchez Aimar, Arvi Jonnarth, Michael Felsberg, Marco KuhlmannCVPR 2023
- GUIDE: Gated Uncertainty-Informed Disentangled Experts for Long-tailed RecognitionYuan Dong, Zhe Zhao, Liheng Yu, Di Wu 等ICLR 2026
