Solver-Free Decision-Focused Learning for Linear Optimization Problems
Senne Berden, Ali Irfan Mahmutogullari, Dimos Tsouros, Tias Guns
Abstract
Mathematical optimization is a fundamental tool for decision-making in a wide range of applications. However, in many real-world scenarios, the parameters of the optimization problem are not known a priori and must be predicted from contextual features. This gives rise to predict-then-optimize problems, where a machine learning model predicts problem parameters that are then used to make decisions via optimization. A growing body of work on decision-focused learning (DFL) addresses this setting by training models specifically to produce predictions that maximize downstream decision quality, rather than accuracy. While effective, DFL is computationally expensive, because it requires solving the optimization problem with the predicted parameters at each loss evaluation. In this work, we address this computational bottleneck for linear optimization problems, a common class of problems in both DFL literature and real-world applications. We propose a solver-free training method that exploits the geometric structure of linear optimization to enable efficient training with minimal degradation in solution quality. Our method is based on the insight that a solution is optimal if and only if it achieves an objective value that is at least as good as that of its adjacent vertices on the feasible polytope. Building on this, our method compares the estimated quality of the ground-truth optimal solution with that of its precomputed adjacent vertices, and uses this as loss function. Experiments demonstrate that our method significantly reduces computational cost while maintaining high decision quality.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 66ddd64d-72dc-4861-a205-a6ea1e46f92fCited by top-tier papers3
- Feasibility-Aware Decision-Focused Learning for Predicting Parameters in the ConstraintsJayanta Mandi, Marianne Defresne, Senne Berden, Tias GunsNeurIPS 2025 · 9 citations
- A Solver-Free Training Method for Predict-then-OptimizeBeichen Wan, Mo LiuICML 2026 · 1 citation
- Decision-Focused Learning via Tangent-Space Projection of Prediction ErrorJunhyeong Lee, Sangjin Jin, Yongjae LeeICML 2026
Builds on7
- Differentiation of Blackbox Combinatorial SolversMarin Vlastelica Pogancic, Anselm Paulus, Vít Musil, Georg Martius et al.ICLR 2020 · 341 citations
- Smart Predict-and-Optimize for Hard Combinatorial Optimization ProblemsJayanta Mandi, Emir Demirovic, Peter J. Stuckey, Tias GunsAAAI 2020 · 184 citations
- Learning with Differentiable Pertubed OptimizersQuentin Berthet, Mathieu Blondel, Olivier Teboul, Marco Cuturi et al.NeurIPS 2020 · 181 citations
- Interior Point Solving for LP-based prediction+optimisationJayanta Mandi, Tias GunsNeurIPS 2020 · 138 citations
- Implicit MLE: Backpropagating Through Discrete Exponential Family DistributionsMathias Niepert, Pasquale Minervini, Luca FranceschiNeurIPS 2021 · 121 citations
Related papers
- Decision-Focused Learning without Decision-Making: Learning Locally Optimized Decision LossesSanket Shah, Kai Wang, Bryan Wilder, Andrew Perrault et al.NeurIPS 2022 · 79 citations
- Decision-Focused Learning: Through the Lens of Learning to RankJayanta Mandi, Víctor Bucarey, Maxime Mulamba Ke Tchomba, Tias GunsICML 2022 · 73 citations
- Learning MDPs from Features: Predict-Then-Optimize for Sequential Decision Making by Reinforcement LearningKai Wang, Sanket Shah, Haipeng Chen, Andrew Perrault et al.NeurIPS 2021 · 44 citations
- Maximum Optimality Margin: A Unified Approach for Contextual Linear Programming and Inverse Linear ProgrammingChunlin Sun, Shang Liu, Xiaocheng LiICML 2023 · 13 citations
- Leaving the Nest: Going beyond Local Loss Functions for Predict-Then-OptimizeSanket Shah, Bryan Wilder, Andrew Perrault, Milind TambeAAAI 2024 · 22 citations
