Differentiable Combinatorial Scheduling at Scale
Mingju Liu, Yingjie Li, Jiaqi Yin, Zhiru Zhang, Cunxi Yu
Abstract
This paper addresses the complex issue of resource-constrained scheduling, an NP-hard problem that spans critical areas including chip design and high-performance computing. Traditional scheduling methods often stumble over scalability and applicability challenges. We propose a novel approach using a differentiable combinatorial scheduling framework, utilizing Gumbel-Softmax differentiable sampling technique. This new technical allows for a fully differentiable formulation of linear programming (LP) based scheduling, extending its application to a broader range of LP formulations. To encode inequality constraints for scheduling tasks, we introduce constrained Gumbel Trick, which adeptly encodes arbitrary inequality constraints. Consequently, our method facilitates an efficient and scalable scheduling via gradient descent without the need for training data. Comparative evaluations on both synthetic and real-world benchmarks highlight our capability to significantly improve the optimization efficiency of scheduling, surpassing state-of-the-art solutions offered by commercial and open-source solvers such as CPLEX, Gurobi, and CP-SAT in the majority of the designs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on8
- vq-wav2vec: Self-Supervised Learning of Discrete Speech RepresentationsAlexei Baevski, Steffen Schneider, Michael AuliICLR 2020 · 730 citations
- Gamora: Graph Learning based Symbolic Reasoning for Large-Scale Boolean NetworksNan Wu, Yingjie Li, Cong Hao, Steve Dai et al.DAC 2023 · 35 citations
- Auto-NBA: Efficient and Effective Search Over the Joint Space of Networks, Bitwidths, and AcceleratorsYonggan Fu, Yongan Zhang, Yang Zhang, David D. Cox et al.ICML 2021 · 23 citations
- Neural Topological Ordering for Computation GraphsMukul Gagrani, Corrado Rainone, Yang Yang, Harris Teague et al.NeurIPS 2022 · 21 citations
- RESPECT: Reinforcement Learning based Edge Scheduling on Pipelined Coral Edge TPUsJiaqi Yin, Yingjie Li, Daniel Robinson, Cunxi YuDAC 2023 · 9 citations
Related papers
- Robust Scheduling with GFlowNetsDavid W. Zhang, Corrado Rainone, Markus Peschl, Roberto BondesanICLR 2023 · 2 citations
- NeuroSchedule: A Novel Effective GNN-based Scheduling Method for High-level SynthesisJun Zeng, Mingyang Kou, Hailong YaoNeurIPS 2022 · 5 citations
- HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture SearchNiv Nayman, Yonathan Aflalo, Asaf Noy, Lihi ZelnikICML 2021 · 41 citations
- Fast Approximations for Job Shop Scheduling: A Lagrangian Dual Deep Learning MethodJames Kotary, Ferdinando Fioretto, Pascal Van HentenryckAAAI 2022 · 27 citations
- Constraint Logic Programming for Real-World Test Laboratory SchedulingTobias Geibinger, Florian Mischek, Nysret MusliuAAAI 2021 · 8 citations
