Pinet: Optimizing hard-constrained neural networks with orthogonal projection layers
Panagiotis D. Grontas, Antonio Terpin, Efe C. Balta, Raffaello D'Andrea, John Lygeros
Abstract
We introduce an output layer for neural networks that ensures satisfaction of convex constraints. Our approach, net, leverages operator splitting for rapid and reliable projections in the forward pass, and the implicit function theorem for backpropagation. We deploy net as a feasible-by-design optimization proxy for parametric constrained optimization problems and obtain modest-accuracy solutions faster than traditional solvers when solving a single problem, and significantly faster for a batch of problems. We surpass state-of-the-art learning approaches by orders of magnitude in terms of training time, solution quality, and robustness to hyperparameter tuning, while maintaining similar inference times. Finally, we tackle multi-vehicle motion planning with non-convex trajectory preferences and provide net as a GPU-ready package implemented in JAX.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on13
- Efficient and Modular Implicit DifferentiationMathieu Blondel, Quentin Berthet, Marco Cuturi, Roy Frostig et al.NeurIPS 2022 · 386 citations
- Monotone operator equilibrium networksEzra Winston, J. Zico KolterNeurIPS 2020 · 177 citations
- Theseus: A Library for Differentiable Nonlinear OptimizationLuis Pineda, Taosha Fan, Maurizio Monge, Shobha Venkataraman et al.NeurIPS 2022 · 124 citations
- Nonsmooth Implicit Differentiation for Machine-Learning and OptimizationJérôme Bolte, Tam Le, Edouard Pauwels, Antonio Silveti-FallsNeurIPS 2021 · 85 citations
- Self-Supervised Primal-Dual Learning for Constrained OptimizationSeonho Park, Pascal Van HentenryckAAAI 2023 · 81 citations
Related papers
- FSNet: Feasibility-Seeking Neural Network for Constrained Optimization with GuaranteesHoang T. Nguyen, Priya L. DontiNeurIPS 2025 · 26 citations
- Design Linear Constrained Neural Layers with Implicit Convex OptimizationJunchi Yan, Jiaxi Liu, Yihui Tu, Fangyuan Zhou et al.ICML 2026
- Improving Feasibility via Fast Autoencoder-Based ProjectionsMaria Chzhen, Priya L. DontiICLR 2026 · 2 citations
- Leveraging augmented-Lagrangian techniques for differentiating over infeasible quadratic programs in machine learningAntoine Bambade, Fabian Schramm, Adrien B. Taylor, Justin CarpentierICLR 2024 · 9 citations
- Sample-Specific Output Constraints for Neural NetworksMathis Brosowsky, Florian Keck, Olaf Dünkel, Marius ZöllnerAAAI 2021 · 12 citations
