Evolutionary Topology Search for Tensor Network Decomposition
Chao Li, Zhun Sun
摘要
tent variable model (Anandkumar et al., 2014) , data restora-Tensor network (TN) decomposition is a promising framework to represent extremely highdimensional problems with few parameters. However, it is challenging to search the (near-)optimal topological structures for TN decomposition, since the number of candidate solutions exponentially grows with increasing the order of a tensor. In this paper, we claim that the issue can be practically tackled by evolutionary algorithms in an affordable manner. We encode the complex topological structures into binary strings, and develop a simple genetic meta-algorithm to search the optimal topology on Hamming space. The experimental results by both synthetic and real-world data demonstrate that our method can effectively discover the ground-truth topology or even better structures with a small number of generations, and significantly boost the representational power of TN decomposition compared with well-known tensor-train (TT) or tensor-ring (TR) models. Our code is available at https://github.com/ minogame/icml2020-TNGA .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper10
- Permutation Search of Tensor Network Structures via Local SamplingChao Li, Junhua Zeng, Zerui Tao, Qibin ZhaoICML 2022 · 被引用 31 次
- Alternating Local Enumeration (TnALE): Solving Tensor Network Structure Search with Fewer EvaluationsChao Li, Junhua Zeng, Chunmei Li, Cesar F. Caiafa 等ICML 2023 · 被引用 24 次
- A Unified Weight Initialization Paradigm for Tensorial Convolutional Neural NetworksYu Pan, Zeyong Su, Ao Liu, Jingquan Wang 等ICML 2022 · 被引用 15 次
- tnGPS: Discovering Unknown Tensor Network Structure Search Algorithms via Large Language Models (LLMs)Junhua Zeng, Chao Li, Zhun Sun, Qibin Zhao 等ICML 2024 · 被引用 10 次
- SVDinsTN: A Tensor Network Paradigm for Efficient Structure Search from Regularized Modeling PerspectiveYu-Bang Zheng, Xi-Le Zhao, Junhua Zeng, Chao Li 等CVPR 2024 · 被引用 9 次
相关 Paper
- Renormalization Group Guided Tensor Network Structure SearchMaolin Wang, Bowen Yu, Sheng Zhang, Linjie Mi 等AAAI 2026 · 被引用 1 次
- Tensor Wheel Decomposition and Its Tensor Completion ApplicationZhong-Cheng Wu, Ting-Zhu Huang, Liang-Jian Deng, Hong-Xia Dou 等NeurIPS 2022 · 被引用 62 次
- Towards Efficient Tensor Decomposition-Based DNN Model Compression With Optimization FrameworkMiao Yin, Yang Sui, Siyu Liao, Bo YuanCVPR 2021
- Fully-Connected Tensor Network Decomposition and Its Application to Higher-Order Tensor CompletionYu-Bang Zheng, Ting-Zhu Huang, Xi-Le Zhao, Qibin Zhao 等AAAI 2021 · 被引用 183 次
- OpEvo: An Evolutionary Method for Tensor Operator OptimizationXiaotian Gao, Wei Cui, Lintao Zhang, Mao YangAAAI 2021 · 被引用 5 次
