Seeing the Unseen: A Semantic Alignment and Context-Aware Prompt Framework for Open-Vocabulary Camouflaged Object Segmentation
Peng Ren, Tian Bai, Jing Sun, Fuming Sun
摘要
Open-Vocabulary Camouflaged Object Segmentation (OV-COS) aims to segment camouflaged objects of any category based on text descriptions. Despite existing openvocabulary methods exhibit strong segmentation capabilities, they still have a major limitation in camouflaged scenarios: semantic confusion, which leads to incomplete segmentation and class shift in the model. To mitigate the above limitation, we propose a framework for OVCOS, named SuCLIP. Specifically, we design a context-aware prompt scheme that leverages the internal knowledge of the CLIP visual encoder to enrich the text prompt and align it with local visual features, thereby enhancing the text prompt. To better align the visual semantic space and the text semantic space, we design a class-aware feature selection module to dynamically adjust text and visual embeddings, making them more matched with camouflaged object. Meanwhile, we introduce a semantic consistency loss to mitigate the semantic deviation between the text prompt and visual features, ensuring semantic consistency between the segmentation results and the text prompt. Finally, we design a text query decoder that precisely maps textual semantics to pixel-level segmentation results, thereby achieving semantic-spatial consistent decoding. Experimental results show that SuCLIP significantly outperforms the advanced method OVCoser on the OVCamo dataset.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Seeing Both Sides: Towards Bidirectional Semantic Alignment for Open-Vocabulary Camouflaged Object SegmentationGuohui Zhang, Fuming Sun, Yu Zhao, Yuqiu Kong 等CVPR 2026
- Training-Free Open-Vocabulary Camouflaged Object Segmentation via Fine-Grained Object Binding and Adaptive Hybrid PromptPeng Ren, Cheng Jiang, Chuande Yang, Fuming Sun 等CVPR 2026
它引用的顶会 Paper27
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Conditional Prompt Learning for Vision-Language ModelsKaiyang Zhou, Jingkang Yang, Chen Change Loy, Ziwei LiuCVPR 2022 · 被引用 1,438 次
- DynamicViT: Efficient Vision Transformers with Dynamic Token SparsificationYongming Rao, Wenliang Zhao, Benlin Liu, Jiwen Lu 等NeurIPS 2021 · 被引用 1,343 次
- Open-vocabulary Object Detection via Vision and Language Knowledge DistillationXiuye Gu, Tsung-Yi Lin, Weicheng Kuo, Yin CuiICLR 2022 · 被引用 1,274 次
- DenseCLIP: Language-Guided Dense Prediction with Context-Aware PromptingYongming Rao, Wenliang Zhao, Guangyi Chen, Yansong Tang 等CVPR 2022 · 被引用 527 次
相关 Paper
- S2C2Seg: Semantic-Spatial Consistency and Category Optimization for Open-Vocabulary SegmentationYuhao Qing, Yueying Wang, Chaoyang Chen, Weidong Zhang 等CVPR 2026
- DPSeg: Dual-Prompt Cost Volume Learning for Open-Vocabulary Semantic SegmentationZiyu Zhao, Xiaoguang Li, Lingjia Shi, Nasrin Imanpour 等CVPR 2025
- Open-Vocabulary Semantic Segmentation with Image Embedding BalancingXiangheng Shan, Dongyue Wu, Guilin Zhu, Yuanjie Shao 等CVPR 2024 · 被引用 18 次
- Open-Vocabulary Segmentation with Semantic-Assisted CalibrationYong Liu, Sule Bai, Guanbin Li, Yitong Wang 等CVPR 2024
- PhaseAlign: Complex Phase Alignment for Stable Open-Vocabulary Semantic SegmentationJiankang Wang, Dingding Jia, Zhoushuopeng, Xuan WangICML 2026
