Explainable Automated Graph Representation Learning with Hyperparameter Importance
Xin Wang, Shuyi Fan, Kun Kuang, Wenwu Zhu
Abstract
Current graph representation (GR) algorithms require huge demand of human experts in hyperparameter tuning, which significantly limits their practical applications, leading to an urge for automated graph representation without human intervention. Although automated machine learning (AutoML) serves as a good candidate for automatic hyperparameter tuning, little literature has been reported on automated graph presentation learning and the only existing work employs a black-box strategy, lacking insights into explaining the relative importance of different hyperparameters. To address this issue, we study explainable automated graph representation with hyperparameter importance in this paper. We propose an explainable AutoML approach for graph representation (e-AutoGR) which utilizes explainable graph features during performance estimation and learns decorrelated importance weights for different hyperparameters in affecting the model performance through a non-linear decorrelated weighting regression. These learned importance weights can in turn help to provide more insights in hyperparameter search procedure. We theoretically prove the soundness of the decorrelated weighting algorithm. Extensive experiments on real-world datasets demonstrate the superiority of our proposed e-AutoGR model against state-of-the-art methods in terms of both model performance and hyperparameter importance explainability.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext dd703bc1-05dc-498e-9755-c58051df2940Cited by top-tier papers6
- Disentangled Contrastive Learning on GraphsHaoyang Li, Xin Wang, Ziwei Zhang, Zehuan Yuan et al.NeurIPS 2021 · 136 citations
- Graph Differentiable Architecture Search with Structure LearningYijian Qin, Xin Wang, Zeyang Zhang, Wenwu ZhuNeurIPS 2021 · 52 citations
- Multimodal Continual Graph Learning with Neural Architecture SearchJie Cai, Xin Wang, Chaoyu Guan, Yateng Tang et al.WWW 2022 · 50 citations
- Adaptive Disentangled Transformer for Sequential RecommendationYipeng Zhang, Xin Wang, Hong Chen, Wenwu ZhuKDD 2023 · 32 citations
- Can Persistent Homology provide an efficient alternative for Evaluation of Knowledge Graph Completion Methods?Anson Bastos, Kuldeep Singh, Abhishek Nadgeri, Johannes Hoffart et al.WWW 2023 · 4 citations
Builds on1
Related papers
- HyperTendril: Visual Analytics for User-Driven Hyperparameter Optimization of Deep Neural NetworksHeungseok Park, Yoonsoo Nam, Jihoon Kim, Jaegul ChooIEEE VIS 2020 · 29 citations
- AutoDAL: Distributed Active Learning with Automatic Hyperparameter SelectionXu Chen, Brett WujekAAAI 2020 · 13 citations
- AutoAttend: Automated Attention Representation SearchChaoyu Guan, Xin Wang, Wenwu ZhuICML 2021 · 46 citations
- AutoGT: Automated Graph Transformer Architecture SearchZizhao Zhang, Xin Wang, Chaoyu Guan, Ziwei Zhang et al.ICLR 2023
- AutoSF: Searching Scoring Functions for Knowledge Graph EmbeddingYongqi Zhang, Quanming Yao, Wenyuan Dai, Lei ChenICDE 2020 · 89 citations
