Dataset Preparation for Arbitrary Object Detection: An Automatic Approach based on Web Information in English
Shucheng Li, Boyu Chang, Bo Yang, Hao Wu, Sheng Zhong, Fengyuan Xu
Abstract
Automatic dataset preparation can help users avoid labor-intensive and costly manual data annotations. The difficulty in preparing a high-quality dataset for object detection involves three key aspects: relevance, naturality, and balance, which are not addressed by existing works. In this paper, we leverage information from the web, and propose a fully-automatic dataset preparation mechanism without any human annotation, which can automatically prepare a high-quality training dataset for the detection task with English text terms describing target objects. It contains three key designs, i.e., keyword expansion, data de-noising, and data balancing. Our experiments demonstrate that the object detectors trained with auto-prepared data are comparable to those trained with benchmark datasets and outperform other baselines. We also demonstrate the effectiveness of our approach in several more challenging real-world object categories that are not included in the benchmark datasets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on7
- SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenEMNLP 2021 · 2,496 citations
- Understanding Contrastive Representation Learning through Alignment and Uniformity on the HypersphereTongzhou Wang, Phillip IsolaICML 2020 · 2,360 citations
- Comprehensive Attention Self-Distillation for Weakly-Supervised Object DetectionZeyi Huang, Yang Zou, B. V. K. Vijaya Kumar, Dong HuangNeurIPS 2020 · 149 citations
- C-MIDN: Coupled Multiple Instance Detection Network With Segmentation Guidance for Weakly Supervised Object DetectionGao Yan, Boxiao Liu, Nan Guo, Xiaochun Ye et al.ICCV 2019 · 130 citations
- Instance Mining with Class Feature Banks for Weakly Supervised Object DetectionYufei Yin, Jiajun Deng, Wengang Zhou, Houqiang LiAAAI 2021 · 46 citations
Related papers
- Simple Multi-dataset DetectionXingyi Zhou, Vladlen Koltun, Philipp KrähenbühlCVPR 2022 · 85 citations
- ImaginaryNet: Learning Object Detectors without Real Images and AnnotationsMinheng Ni, Zitong Huang, Kailai Feng, Wangmeng ZuoICLR 2023 · 5 citations
- nocaps: novel object captioning at scaleHarsh Agrawal, Peter Anderson, Karan Desai, Yufei Wang et al.ICCV 2019 · 631 citations
- Cap2Det: Learning to Amplify Weak Caption Supervision for Object DetectionKeren Ye, Mingda Zhang, Adriana Kovashka, Wei Li et al.ICCV 2019 · 61 citations
- OmniLabel: A Challenging Benchmark for Language-Based Object DetectionSamuel Schulter, Vijay Kumar B. G, Yumin Suh, Konstantinos M. Dafnis et al.ICCV 2023 · 18 citations
