Lipschitz Optimization for Formal Verification of Homographies
Jean-Guillaume Durand, Panagiotis Kouvaros, Maxime Gariel, Alessio Lomuscio
摘要
The adoption of vision neural networks in regulated industries requires formal robustness guarantees, especially in safety-critical domains such as healthcare, aerospace, and autonomous vehicles. However, current approaches are confined to incomplete statistical verification, or robustness to -norm or affine transforms which represent a limited subset of perturbations to the image formation process.In this paper, we present a formal verification approach when the capturing camera undergoes 3D motion perturbations. We first establish a closed-form mapping from camera pose to pixel values. By analyzing the continuity properties of the resulting homographies, we show that recent work on Lipschitz optimization and piecewise continuity can be extended to derive tight linear bounds on perturbed pixel values. While our formulae are grounded in the vision-based landing problem, they generalize to other scenes with predominantly planar features (e.g., augmented reality, traffic signs). This enables formal verification against a broad class of projective geometry transformations, without requiring simulation or complex modeling of image formation.We first validate our implementation, and show up to 89% speedup and 7% tighter bounds than the latest work. We then evaluate our method on established benchmarks from the VNN Competition, and highlight key model vulnerabilities to 3D transforms. Finally, we perform the first formal verification of a vision-based landing system under 3D perturbations, addressing a key challenge in the regulatory certification of learned models for real-world systems. The data and code used for this paper are publicly available.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper10
- Automatic Perturbation Analysis for Scalable Certified Robustness and BeyondKaidi Xu, Zhouxing Shi, Huan Zhang, Yihan Wang 等NeurIPS 2020 · 被引用 415 次
- Fast and Complete: Enabling Complete Neural Network Verification with Rapid and Massively Parallel Incomplete VerifiersKaidi Xu, Huan Zhang, Shiqi Wang, Yihan Wang 等ICLR 2021 · 被引用 250 次
- General Cutting Planes for Bound-Propagation-Based Neural Network VerificationHuan Zhang, Shiqi Wang, Kaidi Xu, Linyi Li 等NeurIPS 2022 · 被引用 154 次
- Efficient Verification of ReLU-Based Neural Networks via Dependency AnalysisElena Botoeva, Panagiotis Kouvaros, Jan Kronqvist, Alessio Lomuscio 等AAAI 2020 · 被引用 140 次
- Fuzz testing based data augmentation to improve robustness of deep neural networksXiang Gao, Ripon K. Saha, Mukul R. Prasad, Abhik RoychoudhuryICSE 2020 · 被引用 116 次
相关 Paper
- Provable Defense Against Geometric TransformationsRem Yang, Jacob Laurel, Sasa Misailovic, Gagandeep SinghICLR 2023 · 被引用 1 次
- Scalable Neural Network Geometric Robustness Validation via Hölder OptimisationYanghao Zhang, Panagiotis Kouvaros, Alessio LomuscioNeurIPS 2025 · 被引用 4 次
- Verifying Structural Robustness of Deep Neural NetworkHai Duong, Thanh Tien Le, Lam Nguyen, ThanhVu NguyenFSE 2026
- Formally Verified Safety Net for Waypoint Navigation Neural Network ControllersAlexei Kopylov, Stefan Mitsch, Aleksey Nogin, Michael A. WarrenFM 2021 · 被引用 4 次
- 3DeformRS: Certifying Spatial Deformations on Point CloudsGabriel Pérez S., Juan C. Pérez, Motasem Alfarra, Silvio Giancola 等CVPR 2022 · 被引用 5 次
