Focus on the Positives: Self-Supervised Learning for Biodiversity Monitoring
Omiros Pantazis, Gabriel J. Brostow, Kate E. Jones, Oisin Mac Aodha
摘要
We address the problem of learning self-supervised representations from unlabeled image collections. Unlike existing approaches that attempt to learn useful features by maximizing similarity between augmented versions of each input image or by speculatively picking negative samples, we instead also make use of the natural variation that occurs in image collections that are captured using static monitoring cameras. To achieve this, we exploit readily available context data that encodes information such as the spatial and temporal relationships between the input images. We are able to learn representations that are surprisingly effective for downstream supervised classification, by first identifying high probability positive pairs at training time, i.e. those images that are likely to depict the same visual concept. For the critical task of global biodiversity monitoring, this results in image features that can be adapted to challenging visual species classification tasks with limited human supervision. We present results on four different camera trap image collections, across three different families of self-supervised learning methods, and show that careful image selection at training time results in superior performance compared to existing baselines such as conventional self-supervised training and transfer learning.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper4
- Extending the WILDS Benchmark for Unsupervised AdaptationShiori Sagawa, Pang Wei Koh, Tony Lee, Irena Gao 等ICLR 2022 · 被引用 116 次
- When Less is Enough: Positive and Unlabeled Learning Model for Vulnerability DetectionXin-Cheng Wen, Xinchen Wang, Cuiyun Gao, Shaohua Wang 等ASE 2023 · 被引用 20 次
- Parameter Efficient Self-Supervised Geospatial Domain AdaptationLinus Scheibenreif, Michael Mommert, Damian BorthCVPR 2024 · 被引用 15 次
- Multiple Instance Learning via Iterative Self-Paced Supervised Contrastive LearningKangning Liu, Weicheng Zhu, Yiqiu Shen, Sheng Liu 等CVPR 2023
它引用的顶会 Paper18
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec 等NeurIPS 2020 · 被引用 9,171 次
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna 等NeurIPS 2020 · 被引用 7,049 次
- Unsupervised Learning of Visual Features by Contrasting Cluster AssignmentsMathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal 等NeurIPS 2020 · 被引用 5,249 次
- SlowFast Networks for Video RecognitionChristoph Feichtenhofer, Haoqi Fan, Jitendra Malik, Kaiming HeICCV 2019 · 被引用 4,104 次
相关 Paper
- Correlational Image Modeling for Self-Supervised Visual Pre-TrainingWei Li, Jiahao Xie, Chen Change LoyCVPR 2023
- NeighborMAE: Exploiting Spatial Dependencies between Neighboring Earth Observation Images in Masked Autoencoders PretrainingLiang Zeng, Valerio Marsocci, Wufan Zhao, Andrea Nascetti 等CVPR 2026 · 被引用 1 次
- Time to augment self-supervised visual representation learningArthur Aubret, Markus Roland Ernst, Céline Teulière, Jochen TrieschICLR 2023 · 被引用 1 次
- Benchmarking Representation Learning for Natural World Image CollectionsGrant Van Horn, Elijah Cole, Sara Beery, Kimberly Wilber 等CVPR 2021
- Exploiting Self-Supervised and Semi-Supervised Learning for Facial Landmark Tracking with Unlabeled DataShi Yin, Shangfei Wang, Xiaoping Chen, Enhong ChenACM MM 2020 · 被引用 7 次
