Renormalization Group Guided Tensor Network Structure Search
Maolin Wang, Bowen Yu, Sheng Zhang, Linjie Mi, Wanyu Wang, Yiqi Wang, Pengyue Jia, Xuetao Wei, Zenglin Xu, Ruocheng Guo, Xiangyu Zhao
摘要
Tensor network structure search (TN-SS) aims to automatically discover optimal network topologies and rank configurations for efficient tensor decomposition in high-dimensional data representation. Despite recent advances, existing TN-SS methods face significant limitations in computational tractability, structure adaptivity, and optimization robustness across diverse tensor characteristics. They struggle with three key challenges: single-scale optimization missing multi-scale structures, discrete search spaces hindering smooth structure evolution, and separated structure-parameter optimization causing computational inefficiency. We propose RGTN (Renormalization Group guided Tensor Network search), a physics-inspired framework transforming TN-SS via multi-scale renormalization group flows. Unlike fixed-scale discrete search methods, RGTN uses dynamic scale-transformation for continuous structure evolution across resolutions. Its core innovation includes learnable edge gates for optimization-stage topology modification and intelligent proposals based on physical quantities like node tension measuring local stress, and edge information flow quantifying connectivity importance. Starting from low-complexity coarse scales and refining to finer ones, RGTN finds compact structures while escaping local minima via scale-induced perturbations. Extensive experiments on light field data, high-order synthetic tensors, and video completion tasks show RGTN achieves state-of-the-art compression ratios and runs 4-600 times faster than existing methods, validating the effectiveness of our physics-inspired approach.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper11
- Ansor: Generating High-Performance Tensor Programs for Deep LearningLianmin Zheng, Chengfan Jia, Minmin Sun, Zhao Wu 等OSDI 2020 · 被引用 551 次
- Fully-Connected Tensor Network Decomposition and Its Application to Higher-Order Tensor CompletionYu-Bang Zheng, Ting-Zhu Huang, Xi-Le Zhao, Qibin Zhao 等AAAI 2021 · 被引用 183 次
- AutoMLP: Automated MLP for Sequential RecommendationsMuyang Li, Zijian Zhang, Xiangyu Zhao, Wanyu Wang 等WWW 2023 · 被引用 70 次
- AutoDim: Field-aware Embedding Dimension Searchin Recommender SystemsXiangyu Zhao, Haochen Liu, Hui Liu, Jiliang Tang 等WWW 2021 · 被引用 69 次
- AutoDenoise: Automatic Data Instance Denoising for RecommendationsWeilin Lin, Xiangyu Zhao, Yejing Wang, Yuanshao Zhu 等WWW 2023 · 被引用 62 次
相关 Paper
- SVDinsTN: A Tensor Network Paradigm for Efficient Structure Search from Regularized Modeling PerspectiveYu-Bang Zheng, Xi-Le Zhao, Junhua Zeng, Chao Li 等CVPR 2024 · 被引用 9 次
- Permutation Search of Tensor Network Structures via Local SamplingChao Li, Junhua Zeng, Zerui Tao, Qibin ZhaoICML 2022 · 被引用 31 次
- tnGPS: Discovering Unknown Tensor Network Structure Search Algorithms via Large Language Models (LLMs)Junhua Zeng, Chao Li, Zhun Sun, Qibin Zhao 等ICML 2024 · 被引用 10 次
- Evolutionary Topology Search for Tensor Network DecompositionChao Li, Zhun SunICML 2020 · 被引用 45 次
- MTNL: A Unified Modeling Perspective for Enhancing Tensor Network LearningJunhua Zeng, Yuning Qiu, Binghua Li, Chao Li 等ICML 2026
