Clip-and-Verify: Linear Constraint-Driven Domain Clipping for Accelerating Neural Network Verification
Duo Zhou, Jorge Chavez, Hesun Chen, Grani A. Hanasusanto, Huan Zhang
摘要
State-of-the-art neural network (NN) verifiers demonstrate that applying the branch-and-bound (BaB) procedure with fast bounding techniques plays a key role in tackling many challenging verification properties. In this work, we introduce the linear constraint-driven clipping framework, a class of scalable and efficient methods designed to enhance the efficacy of NN verifiers. Under this framework, we develop two novel algorithms that efficiently utilize linear constraints to 1) reduce portions of the input space that are either verified or irrelevant to a subproblem in the context of branch-and-bound, and 2) directly improve intermediate bounds throughout the network. The process novelly leverages linear constraints that often arise from bound propagation methods and is general enough to also incorporate constraints from other sources. It efficiently handles linear constraints using a specialized GPU procedure that can scale to large neural networks without the use of expensive external solvers. Our verification procedure, Clip-and-Verify, consistently tightens bounds across multiple benchmarks and can significantly reduce the number of subproblems handled during BaB. We show that our clipping algorithms can be integrated with BaB-based verifiers such as -CROWN, utilizing either the split constraints in activation-space BaB or the output constraints that denote the unverified input space. We demonstrate the effectiveness of our procedure on a broad range of benchmarks where, in some instances, we witness a 96% reduction in the number of subproblems during branch-and-bound, and also achieve state-of-the-art verified accuracy across multiple benchmarks. Clip-and-Verify is part of the -CROWN verifier (http://abcrown.org), the VNN-COMP 2025 winner. Code available at https://github.com/Verified-Intelligence/Clip_and_Verify.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper19
- AI2: Safety and Robustness Certification of Neural Networks with Abstract InterpretationTimon Gehr, Matthew Mirman, Dana Drachsler-Cohen, Petar Tsankov 等S&P 2018 · 被引用 987 次
- Formal Security Analysis of Neural Networks using Symbolic IntervalsShiqi Wang, Kexin Pei, Justin Whitehouse, Junfeng Yang 等USENIX Security 2018 · 被引用 523 次
- Beta-CROWN: Efficient Bound Propagation with Per-neuron Split Constraints for Neural Network Robustness VerificationShiqi Wang, Huan Zhang, Kaidi Xu, Xue Lin 等NeurIPS 2021 · 被引用 359 次
- Practical Large-Scale Linear Programming using Primal-Dual Hybrid GradientDavid L. Applegate, Mateo Díaz, Oliver Hinder, Haihao Lu 等NeurIPS 2021 · 被引用 165 次
- General Cutting Planes for Bound-Propagation-Based Neural Network VerificationHuan Zhang, Shiqi Wang, Kaidi Xu, Linyi Li 等NeurIPS 2022 · 被引用 154 次
相关 Paper
- Scalable Neural Network Verification with Branch-and-bound Inferred Cutting PlanesDuo Zhou, Christopher Brix, Grani A. Hanasusanto, Huan ZhangNeurIPS 2024 · 被引用 49 次
- SDP-CROWN: Efficient Bound Propagation for Neural Network Verification with Tightness of Semidefinite ProgrammingHong-Ming Chiu, Hao Chen, Huan Zhang, Richard Y. ZhangICML 2025
- Provably Bounding Neural Network PreimagesSuhas Kotha, Christopher Brix, J. Zico Kolter, Krishnamurthy Dvijotham 等NeurIPS 2023 · 被引用 41 次
- Complete Verification via Multi-Neuron Relaxation Guided Branch-and-BoundClaudio Ferrari, Mark Niklas Müller, Nikola Jovanovic, Martin T. VechevICLR 2022 · 被引用 117 次
- Neural Network Branching for Neural Network VerificationJingyue Lu, M. Pawan KumarICLR 2020 · 被引用 74 次
