Learnability Lock: Authorized Learnability Control Through Adversarial Invertible Transformations
Weiqi Peng, Jinghui Chen
Abstract
Owing much to the revolution of information technology, the recent progress of deep learning benefits incredibly from the vastly enhanced access to data available in various digital formats. However, in certain scenarios, people may not want their data being used for training commercial models and thus studied how to attack the learnability of deep learning models. Previous works on learnability attack only consider the goal of preventing unauthorized exploitation on the specific dataset but not the process of restoring the learnability for authorized cases. To tackle this issue, this paper introduces and investigates a new concept called "learnability lock" for controlling the model's learnability on a specific dataset with a special key. In particular, we propose adversarial invertible transformation, that can be viewed as a mapping from image to image, to slightly modify data samples so that they become "unlearnable" by machine learning models with negligible loss of visual features. Meanwhile, one can unlock the learnability of the dataset and train models normally using the corresponding key. The proposed learnability lock leverages class-wise perturbation that applies a universal transformation function on data samples of the same label. This ensures that the learnability can be easily restored with a simple inverse transformation while remaining difficult to be detected or reverse-engineered. We empirically demonstrate the success and practicability of our method on visual classification tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- Autoregressive Perturbations for Data PoisoningPedro Sandoval Segura, Vasu Singla, Jonas Geiping, Micah Goldblum et al.NeurIPS 2022 · 62 citations
- One-shot Neural Backdoor Erasing via Adversarial Weight MaskingShuwen Chai, Jinghui ChenNeurIPS 2022 · 49 citations
- What Can We Learn from Unlearnable Datasets?Pedro Sandoval Segura, Vasu Singla, Jonas Geiping, Micah Goldblum et al.NeurIPS 2023 · 28 citations
Builds on10
- Towards Evaluating the Robustness of Neural NetworksNicholas Carlini, David A. WagnerS&P 2017 · 9,786 citations
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable FeaturesSangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh et al.ICCV 2019 · 5,843 citations
- Minimally distorted Adversarial Examples with a Fast Adaptive Boundary AttackFrancesco Croce, Matthias HeinICML 2020 · 597 citations
- Witches' Brew: Industrial Scale Data Poisoning via Gradient MatchingJonas Geiping, Liam H. Fowl, W. Ronny Huang, Wojciech Czaja et al.ICLR 2021 · 268 citations
- Unlearnable Examples: Making Personal Data UnexploitableHanxun Huang, Xingjun Ma, Sarah Monazam Erfani, James Bailey et al.ICLR 2021 · 255 citations
Related papers
- Ungeneralizable ExamplesJingwen Ye, Xinchao WangCVPR 2024 · 3 citations
- Unlearnable 3D Point Clouds: Class-wise Transformation Is All You NeedXianlong Wang, Minghui Li, Wei Liu, Hangtao Zhang et al.NeurIPS 2024 · 23 citations
- CUDA: Convolution-Based Unlearnable DatasetsVinu Sankar Sadasivan, Mahdi Soltanolkotabi, Soheil FeiziCVPR 2023
- One-Pixel Shortcut: On the Learning Preference of Deep Neural NetworksShutong Wu, Sizhe Chen, Cihang Xie, Xiaolin HuangICLR 2023 · 4 citations
- Unsupervised Non-transferable Text ClassificationGuangtao Zeng, Wei LuEMNLP 2022 · 4 citations
