RESCHED: Rethinking Flexible Job Shop Scheduling from a Transformer-based Architecture with Simplified States
Xiangjie Xiao, Cong Zhang, Wen Song, Zhiguang Cao
Abstract
Neural approaches to the Flexible Job Shop Scheduling Problem (FJSP), particularly those based on deep reinforcement learning (DRL), have gained growing attention in recent years. However, existing methods rely on complex featureengineered state representations (i.e., often requiring more than 20 handcrafted features) and graph-biased neural architectures. To reduce modeling complexity and advance a more generalizable framework for FJSP, we introduce RESCHED, a minimalist DRL framework that rethinks both the scheduling formulation and model design. First, by revisiting the Markov Decision Process (MDP) formulation of FJSP, we condense the state space to just four essential features, eliminating historical dependencies through a subproblem-based perspective. Second, we employ Transformer blocks with dot-product attention, augmented by three lightweight but effective architectural modifications tailored to scheduling tasks. Extensive experiments show that RESCHED outperforms classical dispatching rules and state-of-the-art DRL methods on FJSP. Moreover, RESCHED also generalizes well to the Job Shop Scheduling Problem (JSSP) and the Flexible Flow Shop Scheduling Problem (FFSP), achieving competitive performance against neural baselines specifically designed for these variants. Our code is available at https://github.com/XiangjieXiao/ReSched . * Corresponding author. 1 For instance, we demonstrate in Appendix B.3 using DANIEL (Wang et al., 2024b) that removing half of the input features does not compromise performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on6
- POMO: Policy Optimization with Multiple Optima for Reinforcement LearningYeong-Dae Kwon, Jinho Choo, Byoungjip Kim, Iljoo Yoon et al.NeurIPS 2020 · 731 citations
- Learning to Dispatch for Job Shop Scheduling via Deep Reinforcement LearningCong Zhang, Wen Song, Zhiguang Cao, Jie Zhang et al.NeurIPS 2020 · 497 citations
- BQ-NCO: Bisimulation Quotienting for Efficient Neural Combinatorial OptimizationDarko Drakulic, Sofia Michel, Florian Mai, Arnaud Sors et al.NeurIPS 2023 · 124 citations
- Dual Operation Aggregation Graph Neural Networks for Solving Flexible Job-Shop Scheduling Problem with Reinforcement LearningPeng Zhao, You Zhou, Di Wang, Zhiguang Cao et al.WWW 2025 · 3 citations
- GOAL: A Generalist Combinatorial Optimization Agent LearnerDarko Drakulic, Sofia Michel, Jean-Marc AndreoliICLR 2025
Related papers
- Deep Reinforcement Learning Guided Improvement Heuristic for Job Shop SchedulingCong Zhang, Zhiguang Cao, Wen Song, Yaoxin Wu et al.ICLR 2024 · 28 citations
- Learning Memory-Enhanced Improvement Heuristics for Flexible Job Shop SchedulingJiaqi Wang, Zhiguang Cao, Peng Zhao, Rui Cao et al.NeurIPS 2025
- Towards Generalizable Multi-Policy Optimization with Self-Evolution for Job SchedulingInguk Choi, Woo-Jin Shin, Sang-Hyun Cho, Hyun-Jung KimNeurIPS 2025 · 4 citations
- Fast Approximations for Job Shop Scheduling: A Lagrangian Dual Deep Learning MethodJames Kotary, Ferdinando Fioretto, Pascal Van HentenryckAAAI 2022 · 27 citations
- Neural DAG Scheduling via One-Shot Priority SamplingWonseok Jeon, Mukul Gagrani, Burak Bartan, Weiliang Will Zeng et al.ICLR 2023
