Any-Way Meta Learning
Junhoo Lee, Yearim Kim, Hyunho Lee, Nojun Kwak
Abstract
Although meta-learning seems promising performance in the realm of rapid adaptability, it is constrained by
fixed cardinality. When faced with tasks of varying cardinalities that were unseen during training,
the model lacks its ability. In this paper, we address and resolve this challenge
by harnessing `label equivalence' emerged from stochastic numeric label assignments during episodic task sampling. Questioning what defines true" meta-learning, we introduce the any-way" learning paradigm, an innovative model training approach that liberates model from
fixed cardinality constraints. Surprisingly, this model not only matches but often outperforms traditional fixed-way models in terms of performance, convergence speed, and stability. This disrupts established notions
about domain generalization. Furthermore, we argue that the inherent
label equivalence naturally lacks semantic information. To bridge this
semantic information gap arising from label equivalence, we further propose a mechanism for infusing semantic class information into the model. This would enhance the model's comprehension and functionality. Experiments conducted on renowned architectures like MAML and ProtoNet affirm the effectiveness of our method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on6
- Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAMLAniruddh Raghu, Maithra Raghu, Samy Bengio, Oriol VinyalsICLR 2020 · 736 citations
- Meta-Learning with Warped Gradient DescentSebastian Flennerhag, Andrei A. Rusu, Razvan Pascanu, Francesco Visin et al.ICLR 2020 · 221 citations
- BOIL: Towards Representation Change for Few-shot LearningJaehoon Oh, Hyungjun Yoo, ChangHwan Kim, Se-Young YunICLR 2021 · 185 citations
- Label Hallucination for Few-Shot ClassificationYiren Jian, Lorenzo TorresaniAAAI 2022 · 47 citations
- SHOT: Suppressing the Hessian along the Optimization Trajectory for Gradient-Based Meta-LearningJunhoo Lee, Jayeon Yoo, Nojun KwakNeurIPS 2023 · 4 citations
Related papers
- How to Train Your MAML to Excel in Few-Shot ClassificationHan-Jia Ye, Wei-Lun ChaoICLR 2022 · 61 citations
- Learning to Balance: Bayesian Meta-Learning for Imbalanced and Out-of-distribution TasksHaebeom Lee, Hayeon Lee, Donghyun Na, Saehoon Kim et al.ICLR 2020 · 115 citations
- Rapid Model Architecture Adaption for Meta-LearningYiren Zhao, Xitong Gao, Ilia Shumailov, Nicolò Fusi et al.NeurIPS 2022 · 8 citations
- Online Fast Adaptation and Knowledge Accumulation (OSAKA): a New Approach to Continual LearningMassimo Caccia, Pau Rodríguez, Oleksiy Ostapenko, Fabrice Normandin et al.NeurIPS 2020 · 83 citations
- Meta-GMVAE: Mixture of Gaussian VAE for Unsupervised Meta-LearningDong Bok Lee, Dongchan Min, Seanie Lee, Sung Ju HwangICLR 2021 · 62 citations
