Differentiable Quadratic Optimization For the Maximum Independent Set Problem
Ismail Alkhouri, Cedric Le Denmat, Yingjie Li, Cunxi Yu, Jia Liu, Rongrong Wang, Alvaro Velasquez
Abstract
Combinatorial Optimization (CO) addresses many important problems, including the challenging Maximum Independent Set (MIS) problem. Alongside exact and heuristic solvers, differentiable approaches have emerged, often using continuous relaxations of quadratic objectives. Noting that an MIS in a graph is a Maximum Clique (MC) in its complement, we propose a new quadratic formulation for MIS by incorporating an MC term, improving convergence and exploration. We show that every maximal independent set corresponds to a local minimizer, derive conditions with respect to the MIS size, and characterize stationary points. To tackle the non-convexity of the objective, we propose optimizing several initializations in parallel using momentum-based gradient descent, complemented by an efficient MIS checking criterion derived from our theory. We dub our method as parallelized Clique-Informed Quadratic Optimization for MIS (pCQO-MIS). Our experimental results demonstrate the effectiveness of the proposed method compared to exact, heuristic, sampling, and data-centric approaches. Notably, our method avoids the out-ofdistribution tuning and reliance on (un)labeled data required by data-centric methods, while achieving superior MIS sizes and competitive runtime relative to their inference time. Additionally, a key advantage of pCQO-MIS is that, unlike exact and heuristic solvers, the run-time scales only with the number of nodes in the graph, not the number of edges. Our code is available at the GitHub repository (pCQO-MIS).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Local-Minima-Preserving Polynomial Relaxation of Ising ProblemsDebraj Banerjee, Santanu Mahapatra, Kunal Narayan ChaudhuryICML 2026
- Local Minima in Quadratic-Penalty Relaxations of Binary Linear ProgramsCheng-Han Huang, Yongliang Sun, Chaoyan Huang, Ismail Alkhouri et al.ICML 2026
Builds on10
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- DIFUSCO: Graph-based Diffusion Solvers for Combinatorial OptimizationZhiqing Sun, Yiming YangNeurIPS 2023 · 356 citations
- Diffusion Models as Plug-and-Play PriorsAlexandros Graikos, Nikolay Malkin, Nebojsa Jojic, Dimitris SamarasNeurIPS 2022 · 323 citations
- Generalize a Small Pre-trained Model to Arbitrarily Large TSP InstancesZhang-Hua Fu, Kai-Bin Qiu, Hongyuan ZhaAAAI 2021 · 247 citations
- DIMES: A Differentiable Meta Solver for Combinatorial Optimization ProblemsRuizhong Qiu, Zhiqing Sun, Yiming YangNeurIPS 2022 · 183 citations
Related papers
- Learning What to Defer for Maximum Independent SetsSungsoo Ahn, Younggyo Seo, Jinwoo ShinICML 2020 · 90 citations
- Distributed Near-Maximum Independent Set Maintenance over Large-scale Dynamic GraphsXubo Wang, Dong Wen, Wenjie Zhang, Ying Zhang et al.ICDE 2023 · 7 citations
- Maximum Independent Set: Self-Training through Dynamic ProgrammingLorenzo Brusca, Lars C. P. M. Quaedvlieg, Stratis Skoulakis, Grigorios Chrysos et al.NeurIPS 2023 · 15 citations
- NuQClq: An Effective Local Search Algorithm for Maximum Quasi-Clique ProblemJiejiang Chen, Shaowei Cai, Shiwei Pan, Yiyuan Wang et al.AAAI 2021 · 20 citations
- Querying Maximum Quasi-independent Set by Pay-and-RecycleXiaochen Liu, Weiguo Zheng, Zhenyi Chen, Zhenying He et al.ICDE 2022 · 1 citation
