MIBP-Cert: Certified Training against Data Perturbations with Mixed-Integer Bilinear Programs
Tobias Lorenz, Marta Kwiatkowska, Mario Fritz
Abstract
Data errors, corruptions, and poisoning attacks during training pose a major threat to the reliability of modern AI systems. While extensive effort has gone into empirical mitigations, the evolving nature of attacks and the complexity of data require a more principled, provable approach to robustly learn on such data - and to understand how perturbations influence the final model. Hence, we introduce MIBP-Cert, a novel certification method based on mixed-integer bilinear programming (MIBP) that computes sound, deterministic bounds to provide provable robustness even under complex threat models. By computing the set of parameters reachable through perturbed or manipulated data, we can predict all possible outcomes and guarantee robustness. To make solving this optimization problem tractable, we propose a novel relaxation scheme that bounds each training step without sacrificing soundness. We demonstrate the applicability of our approach to continuous and discrete data, as well as different threat models - including complex ones that were previously out of reach.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e15b23b8-3c9e-462e-a40f-a86ea3c03d24Builds on10
- When Does Machine Learning FAIL? Generalized Transferability for Evasion and Poisoning AttacksOctavian Suciu, Radu Marginean, Yigitcan Kaya, Hal Daumé III et al.USENIX Security 2018 · 321 citations
- Certified Robustness to Label-Flipping Attacks via Randomized SmoothingElan Rosenfeld, Ezra Winston, Pradeep Ravikumar, J. Zico KolterICML 2020 · 182 citations
- Intrinsic Certified Robustness of Bagging against Data Poisoning AttacksJinyuan Jia, Xiaoyu Cao, Neil Zhenqiang GongAAAI 2021 · 155 citations
- Improved Certified Defenses against Data Poisoning with (Deterministic) Finite AggregationWenxiao Wang, Alexander Levine, Soheil FeiziICML 2022 · 68 citations
- BagFlip: A Certified Defense Against Data PoisoningYuhao Zhang, Aws Albarghouthi, Loris D'AntoniNeurIPS 2022 · 32 citations
Related papers
- Tight Certification of Adversarially Trained Neural Networks via Nonconvex Low-Rank Semidefinite RelaxationsHong-Ming Chiu, Richard Y. ZhangICML 2023 · 4 citations
- Towards Robustness Certification Against Universal PerturbationsYi Zeng, Zhouxing Shi, Ming Jin, Feiyang Kang et al.ICLR 2023
- Certifiable Robustness of Graph Convolutional Networks under Structure PerturbationsDaniel Zügner, Stephan GünnemannKDD 2020 · 44 citations
- How Robust Are Randomized Smoothing Based Defenses to Data Poisoning?Akshay Mehra, Bhavya Kailkhura, Pin-Yu Chen, Jihun HammCVPR 2021
- Verifying message-passing neural networks via topology-based bounds tighteningChristopher Hojny, Shiqiang Zhang, Juan S. Campos, Ruth MisenerICML 2024 · 15 citations
