Object Segmentation Without Labels with Large-Scale Generative Models
Andrey Voynov, Stanislav Morozov, Artem Babenko
Abstract
The recent rise of unsupervised and selfsupervised learning has dramatically reduced the dependency on labeled data, providing effective image representations for transfer to downstream vision tasks. Furthermore, recent works employed these representations in a fully unsupervised setup for image classification, reducing the need for human labels on the fine-tuning stage as well. This work demonstrates that large-scale unsupervised models can also perform a more challenging object segmentation task, requiring neither pixellevel nor image-level labeling. Namely, we show that recent unsupervised GANs allow to differentiate between foreground/background pixels, providing high-quality saliency masks. By extensive comparison on standard benchmarks, we outperform existing unsupervised alternatives for object segmentation, achieving new state-of-the-art. Our model and implementation are available online 2 .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4b7271bb-f127-48da-8b40-1e29de70a438Cited by top-tier papers24
- Label-Efficient Semantic Segmentation with Diffusion ModelsDmitry Baranchuk, Andrey Voynov, Ivan Rubachev, Valentin Khrulkov et al.ICLR 2022 · 700 citations
- Dataset Diffusion: Diffusion-based Synthetic Data Generation for Pixel-Level Semantic SegmentationQuang Nguyen, Truong Vu, Anh Tran, Khoi NguyenNeurIPS 2023 · 154 citations
- Self-Supervised Transformers for Unsupervised Object Discovery using Normalized CutYangtao Wang, Xi Shen, Shell Xu Hu, Yuan Yuan et al.CVPR 2022 · 143 citations
- Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and LocalizationLuke Melas-Kyriazi, Christian Rupprecht, Iro Laina, Andrea VedaldiCVPR 2022 · 132 citations
- Multi-Source Uncertainty Mining for Deep Unsupervised Saliency DetectionYifan Wang, Wenbo Zhang, Lijun Wang, Ting Liu et al.CVPR 2022 · 58 citations
Builds on6
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Unsupervised Learning of Visual Features by Contrasting Cluster AssignmentsMathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal et al.NeurIPS 2020 · 5,249 citations
- Generative Pretraining From PixelsMark Chen, Alec Radford, Rewon Child, Jeffrey Wu et al.ICML 2020 · 1,773 citations
- Unsupervised Discovery of Interpretable Directions in the GAN Latent SpaceAndrey Voynov, Artem BabenkoICML 2020 · 459 citations
Related papers
- Repurposing GANs for One-Shot Semantic Part SegmentationNontawat Tritrong, Pitchaporn Rewatbowornwong, Supasorn SuwajanakornCVPR 2021
- MOVE: Unsupervised Movable Object Segmentation and DetectionAdam Bielski, Paolo FavaroNeurIPS 2022 · 30 citations
- Unsupervised Semantic Segmentation with Self-supervised Object-centric RepresentationsAndrii Zadaianchuk, Matthäus Kleindessner, Yi Zhu, Francesco Locatello et al.ICLR 2023 · 16 citations
- Finding an Unsupervised Image Segmenter in each of your Deep Generative ModelsLuke Melas-Kyriazi, Christian Rupprecht, Iro Laina, Andrea VedaldiICLR 2022 · 61 citations
- Labels4Free: Unsupervised Segmentation using StyleGANRameen Abdal, Peihao Zhu, Niloy J. Mitra, Peter WonkaICCV 2021 · 88 citations
