Can You Spot the Chameleon? Adversarially Camouflaging Images from Co-Salient Object Detection
Ruijun Gao, Qing Guo, Felix Juefei-Xu, Hongkai Yu, Huazhu Fu, Wei Feng, Yang Liu, Song Wang
Abstract
Co-salient object detection (CoSOD) has recently achieved significant progress and played a key role in retrieval-related tasks. However, it inevitably poses an entirely new safety and security issue, i.e., highly personal and sensitive content can potentially be extracting by powerful CoSOD methods. In this paper, we address this problem from the perspective of adversarial attacks and identify a novel task: adversarial co-saliency attack. Specially, given an image selected from a group of images containing some common and salient objects, we aim to generate an adversarial version that can mislead CoSOD methods to predict incorrect co-salient regions. Note that, compared with general white-box adversarial attacks for classification, this new task faces two additional challenges: (1) low success rate due to the diverse appearance of images in the group; (2) low transferability across CoSOD methods due to the considerable difference between CoSOD pipelines. To address these challenges, we propose the very first blackbox joint adversarial exposure and noise attack (Jadena), where we jointly and locally tune the exposure and additive perturbations of the image according to a newly designed high-feature-level contrast-sensitive loss function. Our method, without any information on the state-of-the-art CoSOD methods, leads to significant performance degradation on various co-saliency detection datasets and makes the co-salient objects undetectable. This can have strong practical benefits in properly securing the large number of personal photos currently shared on the Internet. Moreover, our method is potential to be utilized as a metric for evaluating the robustness of CoSOD methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers5
- Advancing Referring Expression Segmentation Beyond Single ImageYixuan Wu, Zhao Zhang, Chi Xie, Feng Zhu et al.ICCV 2023 · 25 citations
- ALA: Naturalness-aware Adversarial Lightness AttackYihao Huang, Liangru Sun, Qing Guo, Felix Juefei-Xu et al.ACM MM 2023 · 15 citations
- PECCVAI: Overcoming the Brittleness of AI Image Watermarking Under Visual Paraphrasing AttacksShreyas Dixit, Ashhar Aziz, Shashwat Bajpai, Vasu Sharma et al.CVPR 2026
- Cosalpure: Learning Concept from Group Images for Robust Co-Saliency DetectionJiayi Zhu, Qing Guo, Felix Juefei-Xu, Yihao Huang et al.CVPR 2024
- Evading DeepFake Detectors via Adversarial Statistical ConsistencyYang Hou, Qing Guo, Yihao Huang, Xiaofei Xie et al.CVPR 2023
Builds on8
- Towards Evaluating the Robustness of Neural NetworksNicholas Carlini, David A. WagnerS&P 2017 · 9,786 citations
- EGNet: Edge Guidance Network for Salient Object DetectionJiaxing Zhao, Jiang-Jiang Liu, Deng-Ping Fan, Yang Cao et al.ICCV 2019 · 1,054 citations
- Adv-watermark: A Novel Watermark Perturbation for Adversarial ExamplesXiaojun Jia, Xingxing Wei, Xiaochun Cao, Xiaoguang HanACM MM 2020 · 84 citations
- Watch out! Motion is Blurring the Vision of Your Deep Neural NetworksQing Guo, Felix Juefei-Xu, Xiaofei Xie, Lei Ma et al.NeurIPS 2020 · 76 citations
- Learning to Adversarially Blur Visual Object TrackingQing Guo, Ziyi Cheng, Felix Juefei-Xu, Lei Ma et al.ICCV 2021 · 52 citations
Related papers
- Co-Salient Object Detection with Uncertainty-Aware Group Exchange-MaskingYang Wu, Huihui Song, Bo Liu, Kaihua Zhang et al.CVPR 2023
- LeNo: Adversarial Robust Salient Object Detection Networks with Learnable NoiseHe Wang, Lin Wan, He TangAAAI 2023 · 29 citations
- Context-Aware Transfer Attacks for Object DetectionZikui Cai, Xinxin Xie, Shasha Li, Mingjun Yin et al.AAAI 2022 · 41 citations
- A New Ensemble Adversarial Attack Powered by Long-Term Gradient MemoriesZhaohui Che, Ali Borji, Guangtao Zhai, Suiyi Ling et al.AAAI 2020 · 32 citations
- CoADNet: Collaborative Aggregation-and-Distribution Networks for Co-Salient Object DetectionQijian Zhang, Runmin Cong, Junhui Hou, Chongyi Li et al.NeurIPS 2020 · 70 citations
