Empowering DINO Representations for Underwater Instance Segmentation via Aligner and Prompter
Zhiyang Chen, Chen Zhang, Hao Fang, Runmin Cong
摘要
Underwater Instance Segmentation (UIS), integrating pixellevel understanding and instance-level discrimination, is a pivotal technology in marine resource exploration and ecological protection. In recent years, large-scale pretrained visual foundation models, exemplified by DINO, have advanced rapidly and demonstrated remarkable performance on complex downstream tasks. In this paper, we demonstrate that DINO can serve as an effective feature learner for UIS, and we introduce DiveSeg, a novel framework built upon two insightful components: (1) The AquaStyle Aligner, designed to embed underwater color style features into the DINO fine-tuning process, facilitating better adaptation to the underwater domain. (2) The ObjectPrior Prompter, which incorporates binary segmentation-based prompts to deliver object-level priors, provides essential guidance for instance segmentation task that requires both object-and instancelevel reasoning. We conduct thorough experiments on the popular UIIS and USIS10K datasets, and the results show that DiveSeg achieves the state-of-the-art performance. Code: https://github.com/ettof/Diveseg .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper16
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou 等ICCV 2021 · 被引用 8,921 次
- WaterMask: Instance Segmentation for Underwater ImageryShijie Lian, Hua Li, Runmin Cong, Suqi Li 等ICCV 2023 · 被引用 72 次
相关 Paper
- Diving into Underwater: Segment Anything Model Guided Underwater Salient Instance Segmentation and A Large-scale DatasetShijie Lian, Ziyi Zhang, Hua Li, Wenjie Li 等ICML 2024 · 被引用 52 次
- MARIS: Marine Open-Vocabulary Instance SegmentationBingyu Li, Feiyu Wang, Da Zhang, Zhiyuan Zhao 等CVPR 2026
- Exploring the Underwater World Segmentation without Extra TrainingBingyu Li, Tao Huo, Da Zhang, Zhiyuan Zhao 等CVPR 2026 · 被引用 18 次
- BiPA: Bilevel Prompt Adaptation for Underwater Instance SegmentationLong Ma, Haoze Zheng, Yuhang Mao, Jinyuan Liu 等CVPR 2026
- Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and SegmentationFeng Li, Hao Zhang, Huaizhe Xu, Shilong Liu 等CVPR 2023
