One Ring to Rule Them All: Certifiably Robust Geometric Perception with Outliers
Heng Yang, Luca Carlone
Abstract
We propose the first general and practical framework to design certifiable algorithms for robust geometric perception in the presence of a large amount of outliers. We investigate the use of a truncated least squares (TLS) cost function, which is known to be robust to outliers, but leads to hard, nonconvex, and nonsmooth optimization problems. Our first contribution is to show that -for a broad class of geometric perception problems-TLS estimation can be reformulated as an optimization over the ring of polynomials and Lasserre's hierarchy of convex moment relaxations is empirically tight at the minimum relaxation order (i.e., certifiably obtains the global minimum of the nonconvex TLS problem). Our second contribution is to exploit the structural sparsity of the objective and constraint polynomials and leverage basis reduction to significantly reduce the size of the semidefinite program (SDP) resulting from the moment relaxation, without compromising its tightness. Our third contribution is to develop scalable dual optimality certifiers from the lens of sums-of-squares (SOS) relaxation, that can compute the suboptimality gap and possibly certify global optimality of any candidate solution (e.g., returned by fast heuristics such as RANSAC or graduated non-convexity). Our dual certifiers leverage Douglas-Rachford Splitting to solve a convex feasibility SDP. Numerical experiments across different perception problems, including single rotation averaging, shape alignment, 3D point cloud and mesh registration, and high-integrity satellite pose estimation, demonstrate the tightness of our relaxations, the correctness of the certification, and the scalability of the proposed dual certifiers to large problems, beyond the reach of current SDP solvers. 1
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers5
- ARCS: Accurate Rotation and Correspondence SearchLiangzu Peng, Manolis C. Tsakiris, René VidalCVPR 2022 · 15 citations
- Dynamical Pose EstimationHeng Yang, Chris Doran, Jean-Jacques E. SlotineICCV 2021 · 10 citations
- Self-Supervised Geometric PerceptionHeng Yang, Wei Dong, Luca Carlone, Vladlen KoltunCVPR 2021
- On the Convergence of IRLS and Its Variants in Outlier-Robust EstimationLiangzu Peng, Christian Kümmerle, René VidalCVPR 2023
- Rotation Coordinate Descent for Fast Globally Optimal Rotation AveragingÁlvaro Parra, Shin-Fang Ch'ng, Tat-Jun Chin, Anders P. Eriksson et al.CVPR 2021
Builds on5
- A Quaternion-Based Certifiably Optimal Solution to the Wahba Problem With OutliersHeng Yang, Luca CarloneICCV 2019 · 82 citations
- Convex Relaxations for Consensus and Non-Minimal Problems in 3D VisionThomas Probst, Danda Pani Paudel, Ajad Chhatkuli, Luc Van GoolICCV 2019 · 14 citations
- Global Optimality for Point Set Registration Using Semidefinite ProgrammingJosé Pedro Iglesias, Carl Olsson, Fredrik KahlCVPR 2020
- A Certifiably Globally Optimal Solution to Generalized Essential Matrix EstimationJi Zhao, Wanting Xu, Laurent KneipCVPR 2020
- In Perfect Shape: Certifiably Optimal 3D Shape Reconstruction From 2D LandmarksHeng Yang, Luca CarloneCVPR 2020
Related papers
- Semidefinite Relaxations for Robust Multiview TriangulationLinus Härenstam-Nielsen, Niclas Zeller, Daniel CremersCVPR 2023
- On the Tightness of Semidefinite Relaxations for Certifying Robustness to Adversarial ExamplesRichard Y. ZhangNeurIPS 2020 · 30 citations
- Neural Sum-of-Squares: Certifying the Nonnegativity of Polynomials with TransformersNico Pelleriti, Christoph Spiegel, Shiwei Liu, David Martínez-Rubio et al.ICLR 2026 · 2 citations
- Pareto Meets Huber: Efficiently Avoiding Poor Minima in Robust EstimationChristopher Zach, Guillaume BourmaudICCV 2019 · 2 citations
- Learning to Solve Hard Minimal ProblemsPetr Hruby, Timothy Duff, Anton Leykin, Tomás PajdlaCVPR 2022
