SDP-CROWN: Efficient Bound Propagation for Neural Network Verification with Tightness of Semidefinite Programming
Hong-Ming Chiu, Hao Chen, Huan Zhang, Richard Y. Zhang
摘要
Neural network verifiers based on linear bound propagation scale impressively to massive models but can be surprisingly loose when neuron coupling is crucial. Conversely, semidefinite programming (SDP) verifiers capture inter-neuron coupling naturally, but their cubic complexity restricts them to only small models. In this paper, we propose SDP-CROWN, a novel hybrid verification framework that combines the tightness of SDP relaxations with the scalability of bound-propagation verifiers. At the core of SDP-CROWN is a new linear bound-derived via SDP principles-that explicitly captures ℓ 2norm-based inter-neuron coupling while adding only one extra parameter per layer. This bound can be integrated seamlessly into any linear bound-propagation pipeline, preserving the inherent scalability of such methods yet significantly improving tightness. In theory, we prove that our inter-neuron bound can be up to a factor of √ n tighter than traditional per-neuron bounds. In practice, when incorporated into the state-ofthe-art α-CROWN verifier, we observe markedly improved verification performance on large models with up to 65 thousand neurons and 2.47 million parameters, achieving tightness that approaches that of costly SDP-based methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper5
- Formal Mechanistic Interpretability: Automated Circuit Discovery with Provable GuaranteesItamar Hadad, Guy Katz, Shahaf BassanICLR 2026 · 被引用 10 次
- Clip-and-Verify: Linear Constraint-Driven Domain Clipping for Accelerating Neural Network VerificationDuo Zhou, Jorge Chavez, Hesun Chen, Grani A. Hanasusanto 等NeurIPS 2025 · 被引用 10 次
- Provably Explaining Neural Additive ModelsShahaf Bassan, Yizhak Yisrael Elboher, Tobias Ladner, Volkan Şahin 等ICLR 2026 · 被引用 3 次
- Verified SHAP: Provable Bounds for Exact Shapley Values of Neural NetworksDavid Boetius, Shahaf Bassan, Guy Katz, Stefan Leue 等ICML 2026
- Provable Repair of Deep Neural Network Defects by Preimage Synthesis and Property RefinementJianan Ma, Jingyi Wang, Qi Xuan, Zhen WangCCS 2025
它引用的顶会 Paper19
- Automatic Perturbation Analysis for Scalable Certified Robustness and BeyondKaidi Xu, Zhouxing Shi, Huan Zhang, Yihan Wang 等NeurIPS 2020 · 被引用 415 次
- Beta-CROWN: Efficient Bound Propagation with Per-neuron Split Constraints for Neural Network Robustness VerificationShiqi Wang, Huan Zhang, Kaidi Xu, Xue Lin 等NeurIPS 2021 · 被引用 359 次
- Fast and Complete: Enabling Complete Neural Network Verification with Rapid and Massively Parallel Incomplete VerifiersKaidi Xu, Huan Zhang, Shiqi Wang, Yihan Wang 等ICLR 2021 · 被引用 250 次
- Scalable Verified Training for Provably Robust Image ClassificationSven Gowal, Krishnamurthy Dvijotham, Robert Stanforth, Rudy Bunel 等ICCV 2019 · 被引用 196 次
- General Cutting Planes for Bound-Propagation-Based Neural Network VerificationHuan Zhang, Shiqi Wang, Kaidi Xu, Linyi Li 等NeurIPS 2022 · 被引用 154 次
相关 Paper
- Towards Evaluating and Training Verifiably Robust Neural NetworksZhaoyang Lyu, Minghao Guo, Tong Wu, Guodong Xu 等CVPR 2021
- Tight Neural Network Verification via Semidefinite Relaxations and Linear ReformulationsJianglin Lan, Yang Zheng, Alessio LomuscioAAAI 2022 · 被引用 22 次
- Scaling the Convex Barrier with Active SetsAlessandro De Palma, Harkirat S. Behl, Rudy Bunel, Philip H. S. Torr 等ICLR 2021 · 被引用 66 次
- Complete Verification via Multi-Neuron Relaxation Guided Branch-and-BoundClaudio Ferrari, Mark Niklas Müller, Nikola Jovanovic, Martin T. VechevICLR 2022 · 被引用 117 次
- Scalable Neural Network Verification with Branch-and-bound Inferred Cutting PlanesDuo Zhou, Christopher Brix, Grani A. Hanasusanto, Huan ZhangNeurIPS 2024 · 被引用 49 次
