Amodal Instance Segmentation with IRAIS Dataset for Sim-to-Real Transfer
Bidong Chen, Lingui Li
摘要
Amodal instance segmentation is hindered by the scarcity of scalable and transferable annotations. We introduce MaviGen, an automated 3D retail scene modeling and rendering framework that generates photorealistic multi-view images with complete amodal masks. Building on MaviGen, we present the IRAIS dataset, a sim-to-real benchmark comprising a large-scale synthetic multi-view set (3D-IRAIS) and a human-annotated real image set (Real-IRAIS), both sharing unified label definitions and evaluation protocols to facilitate rigorous transfer studies. We propose EUREKA, an encoder-only, query-efficient network for amodal instance segmentation that performs full-image multi-task inference via unified amodal/visible queries and dual mask heads. The dual heads enable mutual supervision between complete and visible masks, while the conditional masked self-attention mechanism further strengthens occlusion reasoning. Experiments establish strong baselines on IRAIS and achieve state-of-the-art performance on D2SA and COCOA-cls, demonstrating substantial improvements in sim-to-real transfer.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- Amodal Segmentation Based on Visible Region Segmentation and Shape PriorYuting Xiao, Yanyu Xu, Ziming Zhong, Weixin Luo 等AAAI 2021 · 被引用 76 次
- Mask Matching Transformer for Few-Shot SegmentationSiyu Jiao, Gengwei Zhang, Shant Navasardyan, Ling Chen 等NeurIPS 2022 · 被引用 54 次
- Amodal Panoptic SegmentationRohit Mohan, Abhinav ValadaCVPR 2022 · 被引用 49 次
- PCA Initialization for Approximate Message Passing in Rotationally Invariant ModelsMarco Mondelli, Ramji VenkataramananNeurIPS 2021 · 被引用 23 次
- MUVA: A New Large-Scale Benchmark for Multi-view Amodal Instance Segmentation in the Shopping ScenarioZhixuan Li, Weining Ye, Juan R. Terven, Zachary Bennett 等ICCV 2023 · 被引用 20 次
相关 Paper
- Segment Anything, Even OccludedWei-En Tai, Yu-Lin Shih, Cheng Sun, Yu-Chiang Frank Wang 等CVPR 2025
- Amodal Scene Analysis via Holistic Occlusion Relation Inference and Generative Mask CompletionBowen Zhang, Qing Liu, Jianming Zhang, Yilin Wang 等AAAI 2024 · 被引用 4 次
- Amodal Ground Truth and Completion in the WildGuanqi Zhan, Chuanxia Zheng, Weidi Xie, Andrew ZissermanCVPR 2024 · 被引用 23 次
- Unveiling the Invisible: Reasoning Complex Occlusions Amodally with AURAZhixuan Li, Hyunse Yoon, Sanghoon Lee, Weisi LinICCV 2025
- Variational Amodal Object CompletionHuan Ling, David Acuna, Karsten Kreis, Seung Wook Kim 等NeurIPS 2020 · 被引用 56 次
