MetaDSE: A Few-shot Meta-learning Framework for Cross-workload CPU Design Space Exploration
Runzhen Xue, Hao Wu, Mingyu Yan, Ziheng Xiao, Xiaochun Ye, Dongrui Fan
摘要
Cross-workload design space exploration (DSE) is crucial in CPU architecture design. Existing DSE methods typically employ the transfer learning technique to leverage knowledge from source workloads, aiming to minimize the requirement of target workload simulation. However, these methods struggle with overfitting, data ambiguity, and workload dissimilarity.
To address these challenges, we reframe the cross-workload CPU DSE task as a few-shot meta-learning problem and further introduce MetaDSE. By leveraging model agnostic meta-learning, MetaDSE swiftly adapts to new target workloads, greatly enhancing the efficiency of cross-workload CPU DSE. Additionally, MetaDSE introduces a novel knowledge transfer method called the workload-adaptive architectural mask algorithm, which uncovers the inherent properties of the architecture. Experiments on SPEC CPU 2017 demonstrate that MetaDSE significantly reduces prediction error by 44.3% compared to the state-of-theart. MetaDSE is open-sourced and available at this anonymous GitHub.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper4
- A Closer Look at Few-shot Classification AgainXu Luo, Hao Wu, Ji Zhang, Lianli Gao 等ICML 2023 · 被引用 80 次
- Learning Pareto-Frontier Resource Management Policies for Heterogeneous SoCs: An Information-Theoretic ApproachAryan Deshwal, Syrine Belakaria, Ganapati Bhat, Janardhan Rao Doppa 等DAC 2021 · 被引用 13 次
- A High-accurate Multi-objective Exploration Framework for Design Space of CPUDuo Wang, Mingyu Yan, Xin Liu, Mo Zou 等DAC 2023 · 被引用 9 次
- Explainable Fuzzy Neural Network with Multi-Fidelity Reinforcement Learning for Micro-Architecture Design Space ExplorationHanwei Fan, Ya Wang, Sicheng Li, Tingyuan Liang 等DAC 2024 · 被引用 2 次
相关 Paper
- Towards Fast Adaptation of Neural Architectures with Meta LearningDongze Lian, Yin Zheng, Yintao Xu, Yanxiong Lu 等ICLR 2020 · 被引用 95 次
- A fast parameter tuning framework via transfer learning and multi-objective bayesian optimizationZheng Zhang, Tinghuan Chen, Jiaxin Huang, Meng ZhangDAC 2022 · 被引用 12 次
- Rapid Model Architecture Adaption for Meta-LearningYiren Zhao, Xitong Gao, Ilia Shumailov, Nicolò Fusi 等NeurIPS 2022 · 被引用 8 次
- M-NAS: Meta Neural Architecture SearchJiaxing Wang, Jiaxiang Wu, Haoli Bai, Jian ChengAAAI 2020 · 被引用 34 次
- Rapid Neural Architecture Search by Learning to Generate Graphs from DatasetsHayeon Lee, Eunyoung Hyung, Sung Ju HwangICLR 2021 · 被引用 57 次
