Pinet: Optimizing hard-constrained neural networks with orthogonal projection layers
Panagiotis D. Grontas, Antonio Terpin, Efe C. Balta, Raffaello D'Andrea, John Lygeros
摘要
We introduce an output layer for neural networks that ensures satisfaction of convex constraints. Our approach, net, leverages operator splitting for rapid and reliable projections in the forward pass, and the implicit function theorem for backpropagation. We deploy net as a feasible-by-design optimization proxy for parametric constrained optimization problems and obtain modest-accuracy solutions faster than traditional solvers when solving a single problem, and significantly faster for a batch of problems. We surpass state-of-the-art learning approaches by orders of magnitude in terms of training time, solution quality, and robustness to hyperparameter tuning, while maintaining similar inference times. Finally, we tackle multi-vehicle motion planning with non-convex trajectory preferences and provide net as a GPU-ready package implemented in JAX.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper13
- Efficient and Modular Implicit DifferentiationMathieu Blondel, Quentin Berthet, Marco Cuturi, Roy Frostig 等NeurIPS 2022 · 被引用 386 次
- Monotone operator equilibrium networksEzra Winston, J. Zico KolterNeurIPS 2020 · 被引用 177 次
- Theseus: A Library for Differentiable Nonlinear OptimizationLuis Pineda, Taosha Fan, Maurizio Monge, Shobha Venkataraman 等NeurIPS 2022 · 被引用 124 次
- Nonsmooth Implicit Differentiation for Machine-Learning and OptimizationJérôme Bolte, Tam Le, Edouard Pauwels, Antonio Silveti-FallsNeurIPS 2021 · 被引用 85 次
- Self-Supervised Primal-Dual Learning for Constrained OptimizationSeonho Park, Pascal Van HentenryckAAAI 2023 · 被引用 81 次
相关 Paper
- FSNet: Feasibility-Seeking Neural Network for Constrained Optimization with GuaranteesHoang T. Nguyen, Priya L. DontiNeurIPS 2025 · 被引用 26 次
- Design Linear Constrained Neural Layers with Implicit Convex OptimizationJunchi Yan, Jiaxi Liu, Yihui Tu, Fangyuan Zhou 等ICML 2026
- Improving Feasibility via Fast Autoencoder-Based ProjectionsMaria Chzhen, Priya L. DontiICLR 2026 · 被引用 2 次
- Leveraging augmented-Lagrangian techniques for differentiating over infeasible quadratic programs in machine learningAntoine Bambade, Fabian Schramm, Adrien B. Taylor, Justin CarpentierICLR 2024 · 被引用 9 次
- Sample-Specific Output Constraints for Neural NetworksMathis Brosowsky, Florian Keck, Olaf Dünkel, Marius ZöllnerAAAI 2021 · 被引用 12 次
