Renormalization Group Guided Tensor Network Structure Search
Maolin Wang, Bowen Yu, Sheng Zhang, Linjie Mi, Wanyu Wang, Yiqi Wang, Pengyue Jia, Xuetao Wei, Zenglin Xu, Ruocheng Guo, Xiangyu Zhao
Abstract
Tensor network structure search (TN-SS) aims to automatically discover optimal network topologies and rank configurations for efficient tensor decomposition in high-dimensional data representation. Despite recent advances, existing TN-SS methods face significant limitations in computational tractability, structure adaptivity, and optimization robustness across diverse tensor characteristics. They struggle with three key challenges: single-scale optimization missing multi-scale structures, discrete search spaces hindering smooth structure evolution, and separated structure-parameter optimization causing computational inefficiency. We propose RGTN (Renormalization Group guided Tensor Network search), a physics-inspired framework transforming TN-SS via multi-scale renormalization group flows. Unlike fixed-scale discrete search methods, RGTN uses dynamic scale-transformation for continuous structure evolution across resolutions. Its core innovation includes learnable edge gates for optimization-stage topology modification and intelligent proposals based on physical quantities like node tension measuring local stress, and edge information flow quantifying connectivity importance. Starting from low-complexity coarse scales and refining to finer ones, RGTN finds compact structures while escaping local minima via scale-induced perturbations. Extensive experiments on light field data, high-order synthetic tensors, and video completion tasks show RGTN achieves state-of-the-art compression ratios and runs 4-600 times faster than existing methods, validating the effectiveness of our physics-inspired approach.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on11
- Ansor: Generating High-Performance Tensor Programs for Deep LearningLianmin Zheng, Chengfan Jia, Minmin Sun, Zhao Wu et al.OSDI 2020 · 551 citations
- Fully-Connected Tensor Network Decomposition and Its Application to Higher-Order Tensor CompletionYu-Bang Zheng, Ting-Zhu Huang, Xi-Le Zhao, Qibin Zhao et al.AAAI 2021 · 183 citations
- AutoMLP: Automated MLP for Sequential RecommendationsMuyang Li, Zijian Zhang, Xiangyu Zhao, Wanyu Wang et al.WWW 2023 · 70 citations
- AutoDim: Field-aware Embedding Dimension Searchin Recommender SystemsXiangyu Zhao, Haochen Liu, Hui Liu, Jiliang Tang et al.WWW 2021 · 69 citations
- AutoDenoise: Automatic Data Instance Denoising for RecommendationsWeilin Lin, Xiangyu Zhao, Yejing Wang, Yuanshao Zhu et al.WWW 2023 · 62 citations
Related papers
- SVDinsTN: A Tensor Network Paradigm for Efficient Structure Search from Regularized Modeling PerspectiveYu-Bang Zheng, Xi-Le Zhao, Junhua Zeng, Chao Li et al.CVPR 2024 · 9 citations
- Permutation Search of Tensor Network Structures via Local SamplingChao Li, Junhua Zeng, Zerui Tao, Qibin ZhaoICML 2022 · 31 citations
- tnGPS: Discovering Unknown Tensor Network Structure Search Algorithms via Large Language Models (LLMs)Junhua Zeng, Chao Li, Zhun Sun, Qibin Zhao et al.ICML 2024 · 10 citations
- Evolutionary Topology Search for Tensor Network DecompositionChao Li, Zhun SunICML 2020 · 45 citations
- MTNL: A Unified Modeling Perspective for Enhancing Tensor Network LearningJunhua Zeng, Yuning Qiu, Binghua Li, Chao Li et al.ICML 2026
