Bootstrapping Top-down Information for Self-modulating Slot Attention
Dongwon Kim, Seoyeon Kim, Suha Kwak
Abstract
Object-centric learning (OCL) aims to learn representations of individual objects within visual scenes without manual supervision, facilitating efficient and effective visual reasoning. Traditional OCL methods primarily employ bottom-up approaches that aggregate homogeneous visual features to represent objects. However, in complex visual environments, these methods often fall short due to the heterogeneous nature of visual features within an object. To address this, we propose a novel OCL framework incorporating a top-down pathway. This pathway first bootstraps the semantics of individual objects and then modulates the model to prioritize features relevant to these semantics. By dynamically modulating the model based on its own output, our top-down pathway enhances the representational quality of objects. Our framework achieves state-of-the-art performance across multiple synthetic and real-world object-discovery benchmarks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a1db6d38-df46-4070-b7a7-79c5604df8d6Cited by top-tier papers2
- MUFASA: A Multi-Layer Framework for Slot AttentionSebastian Bock, Leonie Schüßler, Krishnakant Singh, Simone Schaub-Meyer et al.CVPR 2026 · 1 citation
- Evaluating Object-Centric Models beyond Object DiscoveryKrishnakant Singh, Simone Schaub-Meyer, Stefan RothICML 2026
Builds on33
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou et al.ICCV 2021 · 8,921 citations
- Object-Centric Learning with Slot AttentionFrancesco Locatello, Dirk Weissenborn, Thomas Unterthiner, Aravindh Mahendran et al.NeurIPS 2020 · 1,275 citations
- Vector-quantized Image Modeling with Improved VQGANJiahui Yu, Xin Li, Jing Yu Koh, Han Zhang et al.ICLR 2022 · 753 citations
- GENESIS: Generative Scene Inference and Sampling with Object-Centric Latent RepresentationsMartin Engelcke, Adam R. Kosiorek, Oiwi Parker Jones, Ingmar PosnerICLR 2020 · 334 citations
Related papers
- Shepherding Slots to Objects: Towards Stable and Robust Object-Centric LearningJinwoo Kim, Janghyuk Choi, Ho-Jin Choi, Seon Joo KimCVPR 2023
- Vector-Quantized Vision Foundation Models for Object-Centric LearningRongzhen Zhao, Vivienne Huiling Wang, Juho Kannala, Joni PajarinenACM MM 2025
- Smoothing Slot Attention Iterations and RecurrencesRongzhen Zhao, Wenyan Yang, Kannala Juho, Joni PajarinenICML 2026 · 4 citations
- Object-Category Aware Reinforcement LearningQi Yi, Rui Zhang, Shaohui Peng, Jiaming Guo et al.NeurIPS 2022 · 7 citations
- An Investigation into Pre-Training Object-Centric Representations for Reinforcement LearningJaesik Yoon, Yi-Fu Wu, Heechul Bae, Sungjin AhnICML 2023 · 59 citations
