Learning to Solve Quadratic Unconstrained Binary Optimization in a Classification Way
Ming Chen, Jie Chun, Shang Xiang, Luona Wei, Yonghao Du, Qian Wan, Yuning Chen, Yingwu Chen
Abstract
The quadratic unconstrained binary optimization (QUBO) is a well-known NP-hard problem that takes an matrix as input and decides an -dimensional 0-1 vector , to optimize a quadratic function. Existing learning-based models that always formulate the solution process as sequential decisions suffer from high computational overload. To overcome this issue, we propose a neural solver called the Value Classification Model (VCM) that formulates the solution process from a classification perspective. It applies a Depth Value Network (DVN) based on graph convolution that exploits the symmetry property in to auto-grasp value features. These features are then fed into a Value Classification Network (VCN) which directly generates classification solutions. Trained by a highly efficient model-tailored Greedy-guided Self Trainer (GST) which does not require any priori optimal labels, VCM significantly outperforms competitors in both computational efficiency and solution quality with a remarkable generalization ability. It can achieve near-optimal solutions in milliseconds with an average optimality gap of just 0.362% on benchmarks with up to 2500 variables. Notably, a VCM trained at a specific DVN depth can steadily find better solutions by simply extending the testing depth, which narrows the gap to 0.034% on benchmarks. To our knowledge, this is the first learning-based model to reach such a performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on6
- POMO: Policy Optimization with Multiple Optima for Reinforcement LearningYeong-Dae Kwon, Jinho Choo, Byoungjip Kim, Iljoo Yoon et al.NeurIPS 2020 · 731 citations
- Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale GeneralizationFu Luo, Xi Lin, Fei Liu, Qingfu Zhang et al.NeurIPS 2023 · 248 citations
- Exploratory Combinatorial Optimization with Reinforcement LearningThomas D. Barrett, William R. Clements, Jakob N. Foerster, A. I. LvovskyAAAI 2020 · 218 citations
- Learning Generalizable Models for Vehicle Routing Problems via Knowledge DistillationJieyi Bi, Yining Ma, Jiahai Wang, Zhiguang Cao et al.NeurIPS 2022 · 114 citations
- Towards Omni-generalizable Neural Methods for Vehicle Routing ProblemsJianan Zhou, Yaoxin Wu, Wen Song, Zhiguang Cao et al.ICML 2023 · 90 citations
Related papers
- Neuromorphic Swarm on RRAM Compute-in-Memory Processor for Solving QUBO ProblemAshwin Sanjay Lele, Muya Chang, Samuel D. Spetalnick, Brian Crafton et al.DAC 2023 · 5 citations
- Fidelity-based Deep Adiabatic SchedulingEli Ovits, Lior WolfICLR 2021
- Learning to Reason: Leveraging Neural Networks for Approximate DNF CountingRalph Abboud, Ismail Ilkan Ceylan, Thomas LukasiewiczAAAI 2020 · 32 citations
- QuAnt: Quantum Annealing with Learnt CouplingsMarcel Seelbach Benkner, Maximilian Krahn, Edith Tretschk, Zorah Lähner et al.ICLR 2023 · 4 citations
- Towards Quantum Machine Learning for Constrained Combinatorial Optimization: a Quantum QAP SolverXinyu Ye, Ge Yan, Junchi YanICML 2023 · 14 citations
