Variational Adversarial Active Learning
Samarth Sinha, Sayna Ebrahimi, Trevor Darrell
Abstract
Active learning aims to develop label-efficient algorithms by sampling the most representative queries to be labeled by an oracle. We describe a pool-based semisupervised active learning algorithm that implicitly learns this sampling mechanism in an adversarial manner. Unlike conventional active learning algorithms, our approach is task agnostic, i.e., it does not depend on the performance of the task for which we are trying to acquire labeled data. Our method learns a latent space using a variational autoencoder (VAE) and an adversarial network trained to discriminate between unlabeled and labeled data. The minimax game between the VAE and the adversarial network is played such that while the VAE tries to trick the adversarial network into predicting that all data points are from the labeled pool, the adversarial network learns how to discriminate between dissimilarities in the latent space. We extensively evaluate our method on various image classification and semantic segmentation benchmark datasets and establish a new state of the art on CIFAR10/100, Caltech-256, ImageNet, Cityscapes, and BDD100K. Our results demonstrate that our adversarial approach learns an effective low dimensional latent space in large-scale settings and provides for a computationally efficient sampling method. 1
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers116
- GroupViT: Semantic Segmentation Emerges from Text SupervisionJiarui Xu, Shalini De Mello, Sifei Liu, Wonmin Byeon et al.CVPR 2022 · 398 citations
- Batch Active Learning at ScaleGui Citovsky, Giulia DeSalvo, Claudio Gentile, Lazaros Karydas et al.NeurIPS 2021 · 220 citations
- Active Learning on a Budget: Opposite Strategies Suit High and Low BudgetsGuy Hacohen, Avihu Dekel, Daphna WeinshallICML 2022 · 163 citations
- Active Domain Adaptation via Clustering Uncertainty-weighted EmbeddingsViraj Prabhu, Arjun Chandrasekaran, Kate Saenko, Judy HoffmanICCV 2021 · 160 citations
- Active Learning for Domain Adaptation: An Energy-Based ApproachBinhui Xie, Longhui Yuan, Shuang Li, Chi Harold Liu et al.AAAI 2022 · 149 citations
Builds on1
Related papers
- Task-Aware Variational Adversarial Active LearningKwanyoung Kim, Dongwon Park, Kwang In Kim, Se Young ChunCVPR 2021
- State-Relabeling Adversarial Active LearningBeichen Zhang, Liang Li, Shijie Yang, Shuhui Wang et al.CVPR 2020
- Low-Budget Active Learning via Wasserstein Distance: An Integer Programming ApproachRafid Mahmood, Sanja Fidler, Marc T. LawICLR 2022 · 44 citations
- A Neural Pre-Conditioning Active Learning Algorithm to Reduce Label ComplexitySeo Taek Kong, Soomin Jeon, Dongbin Na, Jaewon Lee et al.NeurIPS 2022 · 7 citations
- Improved Algorithms for Agnostic Pool-based Active ClassificationJulian Katz-Samuels, Jifan Zhang, Lalit Jain, Kevin JamiesonICML 2021 · 26 citations
