Generalization Guarantees for Learning Score-Based Branch-and-Cut Policies in Integer Programming
Hongyu Cheng, Amitabh Basu
Abstract
Mixed-integer programming (MIP) provides a powerful framework for optimization problems, with Branch-and-Cut (B&C) being the predominant algorithm in state-of-the-art solvers. The efficiency of B&C critically depends on heuristic policies for making sequential decisions, including node selection, cut selection, and branching variable selection. While traditional solvers often employ heuristics with manually tuned parameters, recent approaches increasingly leverage machine learning, especially neural networks, to learn these policies directly from data.
A key challenge is to understand the theoretical underpinnings of these learned policies, particularly their generalization performance from finite data. This paper establishes rigorous sample complexity bounds for learning B&C policies where the scoring functions guiding each decision step (node, cut, branch) have a certain piecewise polynomial structure. This structure generalizes the linear models that form the most commonly deployed policies in practice and investigated recently in a foundational series of theoretical works by Balcan et al. Such piecewise polynomial policies also cover the neural network architectures (e.g., using ReLU activations) that have been the focal point of contemporary practical studies. Consequently, our theoretical framework closely reflects the models utilized by practitioners investigating machine learning within B&C, offering a unifying perspective relevant to both established theory and modern empirical research in this area. Furthermore, our theory applies to quite general sequential decision making problems beyond B&C.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a7d0740b-3530-4b16-87e2-cf6f0c8c4faaCited by top-tier papers2
- Provably Data-driven Lagrangian Relaxation for Mixed Integer Linear ProgrammingQUOC TUNG LE, Anh Nguyen, Viet Anh NguyenICML 2026 · 2 citations
- Provably Data-driven Multiple Hyper-parameter Tuning with Structured Loss FunctionQUOC TUNG LE, Anh Nguyen, Viet Anh NguyenICML 2026 · 2 citations
Builds on12
- Reinforcement Learning for Integer Programming: Learning to CutYunhao Tang, Shipra Agrawal, Yuri FaenzaICML 2020 · 224 citations
- Learning to Cut by Looking Ahead: Cutting Plane Selection via Imitation LearningMax B. Paulus, Giulia Zarpellon, Andreas Krause, Laurent Charlin et al.ICML 2022 · 86 citations
- Sample Complexity of Tree Search Configuration: Cutting Planes and BeyondMaria-Florina Balcan, Siddharth Prasad, Tuomas Sandholm, Ellen VitercikNeurIPS 2021 · 54 citations
- Structural Analysis of Branch-and-Cut and the Learnability of Gomory Mixed Integer CutsMaria-Florina Balcan, Siddharth Prasad, Tuomas Sandholm, Ellen VitercikNeurIPS 2022 · 32 citations
- Provably tuning the ElasticNet across instancesMaria-Florina Balcan, Misha Khodak, Dravyansh Sharma, Ameet TalwalkarNeurIPS 2022 · 28 citations
Related papers
- Sample Complexity of Algorithm Selection Using Neural Networks and Its Applications to Branch-and-CutHongyu Cheng, Sammy Khalife, Barbara Fiedorowicz, Amitabh BasuNeurIPS 2024 · 9 citations
- How hard is learning to cut? Trade-offs and sample complexitySammy Khalife, Andrea LodiICLR 2026 · 1 citation
- Theoretical Challenges in Learning for Branch-and-CutHongyu Cheng, Amitabh BasuICML 2026
- Search Strategy Generation for Branch and Bound Using Genetic ProgrammingGwen Maudet, Grégoire DanoyAAAI 2025 · 5 citations
- Accelerating Primal Solution Findings for Mixed Integer Programs Based on Solution PredictionJian-Ya Ding, Chao Zhang, Lei Shen, Shengyin Li et al.AAAI 2020 · 119 citations
