Amodal Instance Segmentation with IRAIS Dataset for Sim-to-Real Transfer
Bidong Chen, Lingui Li
Abstract
Amodal instance segmentation is hindered by the scarcity of scalable and transferable annotations. We introduce MaviGen, an automated 3D retail scene modeling and rendering framework that generates photorealistic multi-view images with complete amodal masks. Building on MaviGen, we present the IRAIS dataset, a sim-to-real benchmark comprising a large-scale synthetic multi-view set (3D-IRAIS) and a human-annotated real image set (Real-IRAIS), both sharing unified label definitions and evaluation protocols to facilitate rigorous transfer studies. We propose EUREKA, an encoder-only, query-efficient network for amodal instance segmentation that performs full-image multi-task inference via unified amodal/visible queries and dual mask heads. The dual heads enable mutual supervision between complete and visible masks, while the conditional masked self-attention mechanism further strengthens occlusion reasoning. Experiments establish strong baselines on IRAIS and achieve state-of-the-art performance on D2SA and COCOA-cls, demonstrating substantial improvements in sim-to-real transfer.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on9
- Amodal Segmentation Based on Visible Region Segmentation and Shape PriorYuting Xiao, Yanyu Xu, Ziming Zhong, Weixin Luo et al.AAAI 2021 · 76 citations
- Mask Matching Transformer for Few-Shot SegmentationSiyu Jiao, Gengwei Zhang, Shant Navasardyan, Ling Chen et al.NeurIPS 2022 · 54 citations
- Amodal Panoptic SegmentationRohit Mohan, Abhinav ValadaCVPR 2022 · 49 citations
- PCA Initialization for Approximate Message Passing in Rotationally Invariant ModelsMarco Mondelli, Ramji VenkataramananNeurIPS 2021 · 23 citations
- MUVA: A New Large-Scale Benchmark for Multi-view Amodal Instance Segmentation in the Shopping ScenarioZhixuan Li, Weining Ye, Juan R. Terven, Zachary Bennett et al.ICCV 2023 · 20 citations
Related papers
- Segment Anything, Even OccludedWei-En Tai, Yu-Lin Shih, Cheng Sun, Yu-Chiang Frank Wang et al.CVPR 2025
- Amodal Scene Analysis via Holistic Occlusion Relation Inference and Generative Mask CompletionBowen Zhang, Qing Liu, Jianming Zhang, Yilin Wang et al.AAAI 2024 · 4 citations
- Amodal Ground Truth and Completion in the WildGuanqi Zhan, Chuanxia Zheng, Weidi Xie, Andrew ZissermanCVPR 2024 · 23 citations
- Unveiling the Invisible: Reasoning Complex Occlusions Amodally with AURAZhixuan Li, Hyunse Yoon, Sanghoon Lee, Weisi LinICCV 2025
- Variational Amodal Object CompletionHuan Ling, David Acuna, Karsten Kreis, Seung Wook Kim et al.NeurIPS 2020 · 56 citations
