LLM4Branch: Large Language Model for Discovering Efficient Branching Policies of Integer Programs
Zhinan Hou, Xingchen Li, Yankai Zhang, Tianxun Li, Keyou You
Abstract
Efficient branching policies are essential for accelerating Mixed Integer Linear Programming (MILP) solvers. Their design has long relied on hand-crafted heuristics, and now machine learning has emerged as a promising paradigm to automate this process. However, existing learningbased methods are often hindered by their dependence on expensive expert demonstrations and the gap between training objectives and the solver's end-to-end performance. In this work, we propose LLM4Branch, a novel framework that leverages Large Language Models (LLMs) to automate the discovery of efficient branching policies. Specifically, the discovered policy is an executable program with a program skeleton generated by the LLM and a parameter vector, which is optimized via a zeroth-order method over a few instances with their end-to-end performance feedback. Extensive experiments on standard MILP benchmarks demonstrate that LLM4Branch establishes a new state-of-the-art among CPU-based methods and achieves performance competitive with advanced GPU-based models. Codes are available at https://github.com/hzn18/LLM4Branch .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on6
- Reinforcement Learning for Branch-and-Bound Optimisation Using Retrospective TrajectoriesChristopher W. F. Parsonson, Alexandre Laterre, Thomas D. BarrettAAAI 2023 · 30 citations
- Rethinking Branching on Exact Combinatorial Optimization Solver: The First Deep Symbolic Discovery FrameworkYufei Kuang, Jie Wang, Haoyang Liu, Fangzhou Zhu et al.ICLR 2024 · 15 citations
- Towards Imitation Learning to Branch for MIP: A Hybrid Reinforcement Learning based Sample Augmentation ApproachChangwen Zhang, Wenli Ouyang, Hao Yuan, Liming Gong et al.ICLR 2024 · 9 citations
- SORREL: Suboptimal-Demonstration-Guided Reinforcement Learning for Learning to BranchShengyu Feng, Yiming YangAAAI 2025 · 6 citations
- Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic DesignZhi Zheng, Zhuoliang Xie, Zhenkun Wang, Bryan HooiICML 2025
Related papers
- Large Language Model-driven Large Neighborhood Search for Large-Scale MILP ProblemsHuigen Ye, Hua Xu, An Yan, Yaoyang ChengICML 2025
- Hybrid Models for Learning to BranchPrateek Gupta, Maxime Gasse, Elias B. Khalil, Pawan Kumar Mudigonda et al.NeurIPS 2020 · 179 citations
- Learning to Branch with Tree MDPsLara Scavuzzo, Feng Yang Chen, Didier Chételat, Maxime Gasse et al.NeurIPS 2022 · 88 citations
- Parameterizing Branch-and-Bound Search Trees to Learn Branching PoliciesGiulia Zarpellon, Jason Jo, Andrea Lodi, Yoshua BengioAAAI 2021 · 123 citations
- CAMBranch: Contrastive Learning with Augmented MILPs for BranchingJiacheng Lin, Meng Xu, Zhihua Xiong, Huangang WangICLR 2024 · 7 citations
