Scalable Mixed-Integer Optimization with Neural Constraints via Dual Decomposition
Shuli Zeng, Sijia Zhang, Feng Wu, Shaojie Tang, Xiangyang Li
Abstract
Embedding deep neural networks (NNs) into mixedinteger programs (MIPs) is attractive for decision making with learned constraints, yet state-of-the-art "monolithic" linearisations blow up in size and quickly become intractable. In this paper, we introduce a novel dual-decomposition framework that relaxes the single coupling equality u = x with an augmented Lagrange multiplier and splits the problem into a vanilla MIP and a constrained NN block. Each part is tackled by the solver that suits it best-branch & cut for the MIP subproblem, firstorder optimisation for the NN subproblem-so the model remains modular, the number of integer variables never grows with network depth, and the per-iteration cost scales only linearly with the NN size. On the public SURROGATELIB benchmark, our method proves scalable, modular, and adaptable: it runs 120× faster than an exact Big-M formulation on the largest test case; the NN sub-solver can be swapped from a log-barrier interior step to a projected-gradient routine with no code changes and identical objective value; and swapping the MLP for an LSTM backbone still completes the full optimisation in 47s without any bespoke adaptation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a3f688c6-3f6b-45f2-9dcd-a9ee3838cca6Builds on2
- Combining Reinforcement Learning and Constraint Programming for Combinatorial OptimizationQuentin Cappart, Thierry Moisan, Louis-Martin Rousseau, Isabeau Prémont-Schwarz et al.AAAI 2021 · 171 citations
- Differentiable Integer Linear ProgrammingZijie Geng, Jie Wang, Xijun Li, Fangzhou Zhu et al.ICLR 2025
Related papers
- Predicting Lagrangian Multipliers for Mixed Integer Linear ProgramsFrancesco Demelas, Joseph Le Roux, Mathieu Lacroix, Axel ParmentierICML 2024 · 6 citations
- On Representing Mixed-Integer Linear Programs by Graph Neural NetworksZiang Chen, Jialin Liu, Xinshang Wang, Wotao YinICLR 2023 · 6 citations
- DOGE-Train: Discrete Optimization on GPU with End-to-End TrainingAhmed Abbas, Paul SwobodaAAAI 2024 · 6 citations
- Learn2Aggregate: Supervised Generation of Chvatal-Gomory Cuts Using Graph Neural NetworksArnaud Deza, Elias B. Khalil, Zhenan Fan, Zirui Zhou et al.AAAI 2025
- A General Neural Backbone for Mixed-Integer Linear Optimization via Dual AttentionPeixin Huang, Yaoxin Wu, Yining Ma, Cathy Wu et al.ICML 2026
