Explainable Automated Graph Representation Learning with Hyperparameter Importance
Xin Wang, Shuyi Fan, Kun Kuang, Wenwu Zhu
摘要
Current graph representation (GR) algorithms require huge demand of human experts in hyperparameter tuning, which significantly limits their practical applications, leading to an urge for automated graph representation without human intervention. Although automated machine learning (AutoML) serves as a good candidate for automatic hyperparameter tuning, little literature has been reported on automated graph presentation learning and the only existing work employs a black-box strategy, lacking insights into explaining the relative importance of different hyperparameters. To address this issue, we study explainable automated graph representation with hyperparameter importance in this paper. We propose an explainable AutoML approach for graph representation (e-AutoGR) which utilizes explainable graph features during performance estimation and learns decorrelated importance weights for different hyperparameters in affecting the model performance through a non-linear decorrelated weighting regression. These learned importance weights can in turn help to provide more insights in hyperparameter search procedure. We theoretically prove the soundness of the decorrelated weighting algorithm. Extensive experiments on real-world datasets demonstrate the superiority of our proposed e-AutoGR model against state-of-the-art methods in terms of both model performance and hyperparameter importance explainability.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper6
- Disentangled Contrastive Learning on GraphsHaoyang Li, Xin Wang, Ziwei Zhang, Zehuan Yuan 等NeurIPS 2021 · 被引用 136 次
- Graph Differentiable Architecture Search with Structure LearningYijian Qin, Xin Wang, Zeyang Zhang, Wenwu ZhuNeurIPS 2021 · 被引用 52 次
- Multimodal Continual Graph Learning with Neural Architecture SearchJie Cai, Xin Wang, Chaoyu Guan, Yateng Tang 等WWW 2022 · 被引用 50 次
- Adaptive Disentangled Transformer for Sequential RecommendationYipeng Zhang, Xin Wang, Hong Chen, Wenwu ZhuKDD 2023 · 被引用 32 次
- Can Persistent Homology provide an efficient alternative for Evaluation of Knowledge Graph Completion Methods?Anson Bastos, Kuldeep Singh, Abhishek Nadgeri, Johannes Hoffart 等WWW 2023 · 被引用 4 次
它引用的顶会 Paper1
相关 Paper
- HyperTendril: Visual Analytics for User-Driven Hyperparameter Optimization of Deep Neural NetworksHeungseok Park, Yoonsoo Nam, Jihoon Kim, Jaegul ChooIEEE VIS 2020 · 被引用 29 次
- AutoDAL: Distributed Active Learning with Automatic Hyperparameter SelectionXu Chen, Brett WujekAAAI 2020 · 被引用 13 次
- AutoAttend: Automated Attention Representation SearchChaoyu Guan, Xin Wang, Wenwu ZhuICML 2021 · 被引用 46 次
- AutoGT: Automated Graph Transformer Architecture SearchZizhao Zhang, Xin Wang, Chaoyu Guan, Ziwei Zhang 等ICLR 2023
- AutoSF: Searching Scoring Functions for Knowledge Graph EmbeddingYongqi Zhang, Quanming Yao, Wenyuan Dai, Lei ChenICDE 2020 · 被引用 89 次
