Generalization Guarantees for Learning Score-Based Branch-and-Cut Policies in Integer Programming
Hongyu Cheng, Amitabh Basu
摘要
Mixed-integer programming (MIP) provides a powerful framework for optimization problems, with Branch-and-Cut (B&C) being the predominant algorithm in state-of-the-art solvers. The efficiency of B&C critically depends on heuristic policies for making sequential decisions, including node selection, cut selection, and branching variable selection. While traditional solvers often employ heuristics with manually tuned parameters, recent approaches increasingly leverage machine learning, especially neural networks, to learn these policies directly from data.
A key challenge is to understand the theoretical underpinnings of these learned policies, particularly their generalization performance from finite data. This paper establishes rigorous sample complexity bounds for learning B&C policies where the scoring functions guiding each decision step (node, cut, branch) have a certain piecewise polynomial structure. This structure generalizes the linear models that form the most commonly deployed policies in practice and investigated recently in a foundational series of theoretical works by Balcan et al. Such piecewise polynomial policies also cover the neural network architectures (e.g., using ReLU activations) that have been the focal point of contemporary practical studies. Consequently, our theoretical framework closely reflects the models utilized by practitioners investigating machine learning within B&C, offering a unifying perspective relevant to both established theory and modern empirical research in this area. Furthermore, our theory applies to quite general sequential decision making problems beyond B&C.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Provably Data-driven Lagrangian Relaxation for Mixed Integer Linear ProgrammingQUOC TUNG LE, Anh Nguyen, Viet Anh NguyenICML 2026 · 被引用 2 次
- Provably Data-driven Multiple Hyper-parameter Tuning with Structured Loss FunctionQUOC TUNG LE, Anh Nguyen, Viet Anh NguyenICML 2026 · 被引用 2 次
它引用的顶会 Paper12
- Reinforcement Learning for Integer Programming: Learning to CutYunhao Tang, Shipra Agrawal, Yuri FaenzaICML 2020 · 被引用 224 次
- Learning to Cut by Looking Ahead: Cutting Plane Selection via Imitation LearningMax B. Paulus, Giulia Zarpellon, Andreas Krause, Laurent Charlin 等ICML 2022 · 被引用 86 次
- Sample Complexity of Tree Search Configuration: Cutting Planes and BeyondMaria-Florina Balcan, Siddharth Prasad, Tuomas Sandholm, Ellen VitercikNeurIPS 2021 · 被引用 54 次
- Structural Analysis of Branch-and-Cut and the Learnability of Gomory Mixed Integer CutsMaria-Florina Balcan, Siddharth Prasad, Tuomas Sandholm, Ellen VitercikNeurIPS 2022 · 被引用 32 次
- Provably tuning the ElasticNet across instancesMaria-Florina Balcan, Misha Khodak, Dravyansh Sharma, Ameet TalwalkarNeurIPS 2022 · 被引用 28 次
相关 Paper
- Sample Complexity of Algorithm Selection Using Neural Networks and Its Applications to Branch-and-CutHongyu Cheng, Sammy Khalife, Barbara Fiedorowicz, Amitabh BasuNeurIPS 2024 · 被引用 9 次
- How hard is learning to cut? Trade-offs and sample complexitySammy Khalife, Andrea LodiICLR 2026 · 被引用 1 次
- Theoretical Challenges in Learning for Branch-and-CutHongyu Cheng, Amitabh BasuICML 2026
- Search Strategy Generation for Branch and Bound Using Genetic ProgrammingGwen Maudet, Grégoire DanoyAAAI 2025 · 被引用 5 次
- Accelerating Primal Solution Findings for Mixed Integer Programs Based on Solution PredictionJian-Ya Ding, Chao Zhang, Lei Shen, Shengyin Li 等AAAI 2020 · 被引用 119 次
