Evolutionary Topology Search for Tensor Network Decomposition
Chao Li, Zhun Sun
Abstract
tent variable model (Anandkumar et al., 2014) , data restora-Tensor network (TN) decomposition is a promising framework to represent extremely highdimensional problems with few parameters. However, it is challenging to search the (near-)optimal topological structures for TN decomposition, since the number of candidate solutions exponentially grows with increasing the order of a tensor. In this paper, we claim that the issue can be practically tackled by evolutionary algorithms in an affordable manner. We encode the complex topological structures into binary strings, and develop a simple genetic meta-algorithm to search the optimal topology on Hamming space. The experimental results by both synthetic and real-world data demonstrate that our method can effectively discover the ground-truth topology or even better structures with a small number of generations, and significantly boost the representational power of TN decomposition compared with well-known tensor-train (TT) or tensor-ring (TR) models. Our code is available at https://github.com/ minogame/icml2020-TNGA .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e16fddd0-aa49-4bec-a1e0-cb7619096d13Cited by top-tier papers10
- Permutation Search of Tensor Network Structures via Local SamplingChao Li, Junhua Zeng, Zerui Tao, Qibin ZhaoICML 2022 · 31 citations
- Alternating Local Enumeration (TnALE): Solving Tensor Network Structure Search with Fewer EvaluationsChao Li, Junhua Zeng, Chunmei Li, Cesar F. Caiafa et al.ICML 2023 · 24 citations
- A Unified Weight Initialization Paradigm for Tensorial Convolutional Neural NetworksYu Pan, Zeyong Su, Ao Liu, Jingquan Wang et al.ICML 2022 · 15 citations
- tnGPS: Discovering Unknown Tensor Network Structure Search Algorithms via Large Language Models (LLMs)Junhua Zeng, Chao Li, Zhun Sun, Qibin Zhao et al.ICML 2024 · 10 citations
- SVDinsTN: A Tensor Network Paradigm for Efficient Structure Search from Regularized Modeling PerspectiveYu-Bang Zheng, Xi-Le Zhao, Junhua Zeng, Chao Li et al.CVPR 2024 · 9 citations
Related papers
- Renormalization Group Guided Tensor Network Structure SearchMaolin Wang, Bowen Yu, Sheng Zhang, Linjie Mi et al.AAAI 2026 · 1 citation
- Tensor Wheel Decomposition and Its Tensor Completion ApplicationZhong-Cheng Wu, Ting-Zhu Huang, Liang-Jian Deng, Hong-Xia Dou et al.NeurIPS 2022 · 62 citations
- Towards Efficient Tensor Decomposition-Based DNN Model Compression With Optimization FrameworkMiao Yin, Yang Sui, Siyu Liao, Bo YuanCVPR 2021
- Fully-Connected Tensor Network Decomposition and Its Application to Higher-Order Tensor CompletionYu-Bang Zheng, Ting-Zhu Huang, Xi-Le Zhao, Qibin Zhao et al.AAAI 2021 · 183 citations
- OpEvo: An Evolutionary Method for Tensor Operator OptimizationXiaotian Gao, Wei Cui, Lintao Zhang, Mao YangAAAI 2021 · 5 citations
