Active Curriculum Refinement for Reinforcement Learning
Zhenya Liu, Yuxin Chen
Abstract
In many RL domains, environments are linked by prerequisite relations—e.g., difficulty-increasing edits or parameter increments—which induce a directed acyclic curriculum graph (DAG). In practice, this structure is often exploited only implicitly, yet it can yield clear gains in training. We introduce PATH, a curriculum learning framework that performs active learning on the curriculum graph. PATH first expands coverage by sampling diverse curriculum paths, then reallocates training toward regions that remain unmastered. Experiments show that PATH leverages the graph structure to achieve strong robustness and generalization across diverse environments.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on16
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- Deep Reinforcement Learning at the Edge of the Statistical PrecipiceRishabh Agarwal, Max Schwarzer, Pablo Samuel Castro, Aaron C. Courville et al.NeurIPS 2021 · 1,067 citations
- Leveraging Procedural Generation to Benchmark Reinforcement LearningKarl Cobbe, Christopher Hesse, Jacob Hilton, John SchulmanICML 2020 · 685 citations
- Emergent Complexity and Zero-shot Transfer via Unsupervised Environment DesignMichael Dennis, Natasha Jaques, Eugene Vinitsky, Alexandre M. Bayen et al.NeurIPS 2020 · 362 citations
- Prioritized Level ReplayMinqi Jiang, Edward Grefenstette, Tim RocktäschelICML 2021 · 211 citations
Related papers
- Curriculum Reinforcement Learning via Constrained Optimal TransportPascal Klink, Haoyi Yang, Carlo D'Eramo, Jan Peters et al.ICML 2022 · 44 citations
- Item-Difficulty-Aware Learning Path Recommendation: From a Real Walking PerspectiveHaotian Zhang, Shuanghong Shen, Bihan Xu, Zhenya Huang et al.KDD 2024 · 3 citations
- Safety-Prioritizing Curricula for Constrained Reinforcement LearningCevahir Köprülü, Thiago D. Simão, Nils Jansen, Ufuk TopcuICLR 2025
- PORTAL: Automatic Curricula Generation for Multiagent Reinforcement LearningJizhou Wu, Jianye Hao, Tianpei Yang, Xiaotian Hao et al.AAAI 2024 · 12 citations
- EAT-C: Environment-Adversarial sub-Task Curriculum for Efficient Reinforcement LearningShuang Ao, Tianyi Zhou, Jing Jiang, Guodong Long et al.ICML 2022 · 6 citations
