Unnoticed Yet Effective: A Hybrid Physical Camouflage Framework Against DNNs and Human Perception
Mingye Xie, Jiacheng Ruan, Xian Gao, Ting Liu, Yuzhuo Fu
Abstract
While adversarial attacks can effectively deceive deep neural networks, their real-world applicability is often limited by complex and conspicuous patterns that reveal their attack intent to human observers. To overcome this limitation, we propose UYE, a novel camouflage framework designed to simultaneously mislead DNNs and evade human perception. UYE incorporates two key components: an attention refiner leveraging a pre-trained vision encoder to optimize adversarial patterns for robust attacks across diverse environments, and a perception evaluator trained on a preference dataset curated using tailored prompts from human-aligned large multimodal models to ensure natural and unobtrusive camouflage generation. Extensive experiments demonstrate that UYE outperforms state-of-the-art methods in achieving an optimal balance between human stealth and model deception while maintaining effectiveness in real-world scenarios.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on9
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- DETRs with Collaborative Hybrid Assignments TrainingZhuofan Zong, Guanglu Song, Yu LiuICCV 2023 · 594 citations
- Naturalistic Physical Adversarial Patch for Object DetectorsYu-Chih-Tuan Hu, Jun-Cheng Chen, Bo-Han Kung, Kai-Lung Hua et al.ICCV 2021 · 224 citations
- FCA: Learning a 3D Full-Coverage Vehicle Camouflage for Multi-View Physical Adversarial AttackDonghua Wang, Tingsong Jiang, Jialiang Sun, Weien Zhou et al.AAAI 2022 · 149 citations
- DeepGaze IIE: Calibrated prediction in and out-of-domain for state-of-the-art saliency modelingAkis Linardos, Matthias Kümmerer, Ori Press, Matthias BethgeICCV 2021 · 98 citations
Related papers
- Adversarial Camouflage: Hiding Physical-World Attacks With Natural StylesRanjie Duan, Xingjun Ma, Yisen Wang, James Bailey et al.CVPR 2020
- ACTIVE: Towards Highly Transferable 3D Physical Camouflage for Universal and Robust Vehicle EvasionNaufal Suryanto, Yongsu Kim, Harashta Tatimma Larasati, Hyoeun Kang et al.ICCV 2023 · 51 citations
- CNCA: Toward Customizable and Natural Generation of Adversarial Camouflage for Vehicle DetectorsLinye Lyu, Jiawei Zhou, Daojing He, Yu LiNeurIPS 2024 · 8 citations
- Deep Camouflage ImagesQing Zhang, Gelin Yin, Yongwei Nie, Wei-Shi ZhengAAAI 2020 · 26 citations
- Universal Physical Camouflage Attacks on Object DetectorsLifeng Huang, Chengying Gao, Yuyin Zhou, Cihang Xie et al.CVPR 2020
