MetaDSE: A Few-shot Meta-learning Framework for Cross-workload CPU Design Space Exploration
Runzhen Xue, Hao Wu, Mingyu Yan, Ziheng Xiao, Xiaochun Ye, Dongrui Fan
Abstract
Cross-workload design space exploration (DSE) is crucial in CPU architecture design. Existing DSE methods typically employ the transfer learning technique to leverage knowledge from source workloads, aiming to minimize the requirement of target workload simulation. However, these methods struggle with overfitting, data ambiguity, and workload dissimilarity.
To address these challenges, we reframe the cross-workload CPU DSE task as a few-shot meta-learning problem and further introduce MetaDSE. By leveraging model agnostic meta-learning, MetaDSE swiftly adapts to new target workloads, greatly enhancing the efficiency of cross-workload CPU DSE. Additionally, MetaDSE introduces a novel knowledge transfer method called the workload-adaptive architectural mask algorithm, which uncovers the inherent properties of the architecture. Experiments on SPEC CPU 2017 demonstrate that MetaDSE significantly reduces prediction error by 44.3% compared to the state-of-theart. MetaDSE is open-sourced and available at this anonymous GitHub.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on4
- A Closer Look at Few-shot Classification AgainXu Luo, Hao Wu, Ji Zhang, Lianli Gao et al.ICML 2023 · 80 citations
- Learning Pareto-Frontier Resource Management Policies for Heterogeneous SoCs: An Information-Theoretic ApproachAryan Deshwal, Syrine Belakaria, Ganapati Bhat, Janardhan Rao Doppa et al.DAC 2021 · 13 citations
- A High-accurate Multi-objective Exploration Framework for Design Space of CPUDuo Wang, Mingyu Yan, Xin Liu, Mo Zou et al.DAC 2023 · 9 citations
- Explainable Fuzzy Neural Network with Multi-Fidelity Reinforcement Learning for Micro-Architecture Design Space ExplorationHanwei Fan, Ya Wang, Sicheng Li, Tingyuan Liang et al.DAC 2024 · 2 citations
Related papers
- Towards Fast Adaptation of Neural Architectures with Meta LearningDongze Lian, Yin Zheng, Yintao Xu, Yanxiong Lu et al.ICLR 2020 · 95 citations
- A fast parameter tuning framework via transfer learning and multi-objective bayesian optimizationZheng Zhang, Tinghuan Chen, Jiaxin Huang, Meng ZhangDAC 2022 · 12 citations
- Rapid Model Architecture Adaption for Meta-LearningYiren Zhao, Xitong Gao, Ilia Shumailov, Nicolò Fusi et al.NeurIPS 2022 · 8 citations
- M-NAS: Meta Neural Architecture SearchJiaxing Wang, Jiaxiang Wu, Haoli Bai, Jian ChengAAAI 2020 · 34 citations
- Rapid Neural Architecture Search by Learning to Generate Graphs from DatasetsHayeon Lee, Eunyoung Hyung, Sung Ju HwangICLR 2021 · 57 citations
