Uncertainty-Guided Transformer Reasoning for Camouflaged Object Detection
Fan Yang, Qiang Zhai, Xin Li, Rui Huang, Ao Luo, Hong Cheng, Deng-Ping Fan
Abstract
Spotting objects that are visually adapted to their surroundings is challenging for both humans and AI. Conventional generic / salient object detection techniques are suboptimal for this task because they tend to only discover easy and clear objects, while overlooking the difficult-to-detect ones with inherent uncertainties derived from indistinguishable textures. In this work, we contribute a novel approach using a probabilistic representational model in combination with transformers to explicitly reason under uncertainties, namely uncertainty-guided transformer reasoning (UGTR), for camouflaged object detection. The core idea is to first learn a conditional distribution over the backbone's output to obtain initial estimates and associated uncertainties, and then reason over these uncertain regions with attention mechanism to produce final predictions. Our approach combines the benefits of both Bayesian learning and Transformer-based reasoning, allowing the model to handle camouflaged object detection by leveraging both deterministic and probabilistic information. We empirically demonstrate that our proposed approach can achieve higher accuracy than existing state-of-the-art models on CHAMELEON, CAMO and COD10K datasets. Code is available at https://github.com/fanyang587/UGTR.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f01b8d7f-fbd3-4c4d-899f-a20ee5157eecCited by top-tier papers34
- Zoom In and Out: A Mixed-scale Triplet Network for Camouflaged Object DetectionYouwei Pang, Xiaoqi Zhao, Tian-Zhu Xiang, Lihe Zhang et al.CVPR 2022 · 417 citations
- Detecting Camouflaged Object in Frequency DomainYijie Zhong, Bo Li, Lv Tang, Senyun Kuang et al.CVPR 2022 · 271 citations
- High-Resolution Iterative Feedback Network for Camouflaged Object DetectionXiaobin Hu, Shuo Wang, Xuebin Qin, Hang Dai et al.AAAI 2023 · 236 citations
- Weakly-Supervised Concealed Object Segmentation with SAM-based Pseudo Labeling and Multi-scale Feature GroupingChunming He, Kai Li, Yachao Zhang, Guoxia Xu et al.NeurIPS 2023 · 205 citations
- Frequency Perception Network for Camouflaged Object DetectionRunmin Cong, Mengyao Sun, Sanyi Zhang, Xiaofei Zhou et al.ACM MM 2023 · 130 citations
Builds on12
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Deformable DETR: Deformable Transformers for End-to-End Object DetectionXizhou Zhu, Weijie Su, Lewei Lu, Bin Li et al.ICLR 2021 · 7,353 citations
- EGNet: Edge Guidance Network for Salient Object DetectionJiaxing Zhao, Jiang-Jiang Liu, Deng-Ping Fan, Yang Cao et al.ICCV 2019 · 1,054 citations
- TrackFormer: Multi-Object Tracking with TransformersTim Meinhardt, Alexander Kirillov, Laura Leal-Taixé, Christoph FeichtenhoferCVPR 2022 · 927 citations
- Robust Person Re-Identification by Modelling Feature UncertaintyTianyuan Yu, Da Li, Yongxin Yang, Timothy M. Hospedales et al.ICCV 2019 · 148 citations
Related papers
- Frequency Representation Integration for Camouflaged Object DetectionChenxi Xie, Changqun Xia, Tianshu Yu, Jia LiACM MM 2023 · 58 citations
- CamoDiffusion: Camouflaged Object Detection via Conditional Diffusion ModelsZhongxi Chen, Ke Sun, Xianming LinAAAI 2024 · 61 citations
- A Unified Query-based Paradigm for Camouflaged Instance SegmentationBo Dong, Jialun Pei, Rongrong Gao, Tian-Zhu Xiang et al.ACM MM 2023 · 19 citations
- CGCOD: Class-Guided Camouflaged Object DetectionChenxi Zhang, Qing Zhang, Jiayun Wu, Youwei PangACM MM 2025 · 11 citations
- Strategic Preys Make Acute Predators: Enhancing Camouflaged Object Detectors by Generating Camouflaged ObjectsChunming He, Kai Li, Yachao Zhang, Yulun Zhang et al.ICLR 2024 · 123 citations
