Text's Armor: Optimized Local Adversarial Perturbation Against Scene Text Editing Attacks
Tao Xiang, Hangcheng Liu, Shangwei Guo, Hantao Liu, Tianwei Zhang
Abstract
Deep neural networks (DNNs) have shown their powerful capability in scene text editing (STE). With carefully designed DNNs, one can alter texts in a source image with other ones while maintaining their realistic look. However, such editing tools provide a great convenience for criminals to falsify documents or modify texts without authorization. In this paper, we propose to actively defeat text editing attacks by designing invisible "armors" for texts in the scene. We turn the adversarial vulnerability of DNN-based STE into strength and design local perturbations (i.e., "armors") specifically for texts using an optimized normalization strategy. Such local perturbations can effectively mislead STE attacks without affecting the perceptibility of scene background. To strengthen our defense capabilities, we systemically analyze and model STE attacks and provide a precise defense method to defeat attacks on different editing stages. We conduct both subjective and objective experiments to show the superior of our optimized local adversarial perturbation against state-of-the-art STE attacks. We also evaluate the portrait and landscape transferability of our perturbations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0c07637d-dc8a-4b91-92ab-cbf87186c3ddCited by top-tier papers2
- Universal Defensive Underpainting Patch: Making Your Text Invisible to Optical Character RecognitionJiacheng Deng, Li Dong, Jiahao Chen, Diqun Yan et al.ACM MM 2023 · 5 citations
- When Measures are Unreliable: Imperceptible Adversarial Perturbations toward Top-k Multi-Label LearningYuchen Sun, Qianqian Xu, Zitai Wang, Qingming HuangACM MM 2023 · 2 citations
Builds on7
- CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating DeepfakesHao Huang, Yongtao Wang, Zhaoyu Chen, Yuze Zhang et al.AAAI 2022 · 131 citations
- De-rendering Stylized TextsWataru Shimoda, Daichi Haraguchi, Seiichi Uchida, Kota YamaguchiICCV 2021 · 34 citations
- Learning Optimization-based Adversarial Perturbations for Attacking Sequential Recognition ModelsXing Xu, Jiefu Chen, Jinhui Xiao, Zheng Wang et al.ACM MM 2020 · 18 citations
- PRNet: A Progressive Recovery Network for Revealing Perceptually Encrypted ImagesTao Xiang, Ying Yang, Shangwei Guo, Hangcheng Liu et al.ACM MM 2021 · 6 citations
- SwapText: Image Based Texts Transfer in ScenesQiangpeng Yang, Jun Huang, Wei LinCVPR 2020
Related papers
- What Machines See Is Not What They Get: Fooling Scene Text Recognition Models With Adversarial Text ImagesXing Xu, Jiefu Chen, Jinhui Xiao, Lianli Gao et al.CVPR 2020
- Word Level Robustness Enhancement: Fight Perturbation with PerturbationPei Huang, Yuting Yang, Fuqi Jia, Minghao Liu et al.AAAI 2022 · 14 citations
- Robust Superpixel-Guided Attentional Adversarial AttackXiaoyi Dong, Jiangfan Han, Dongdong Chen, Jiayang Liu et al.CVPR 2020
- Exploring Stroke-Level Modifications for Scene Text EditingYadong Qu, Qingfeng Tan, Hongtao Xie, Jianjun Xu et al.AAAI 2023 · 51 citations
- RMLM: A Flexible Defense Framework for Proactively Mitigating Word-level Adversarial AttacksZhaoyang Wang, Zhiyue Liu, Xiaopeng Zheng, Qinliang Su et al.ACL 2023 · 16 citations
