A Sampling-Based Method for Tensor Ring Decomposition
Osman Asif Malik, Stephen Becker
Abstract
We propose a sampling based method for computing the tensor ring (TR) decomposition of a data tensor. The method uses leverage score sampled alternating least squares to fit the TR cores in an iterative fashion. By taking advantage of the special structure of TR tensors, we can efficiently estimate the leverage scores and attain a method which has complexity sublinear in the number of input tensor entries. We provide relative error high probability guarantees for the sampled least squares problems. We compare our proposal to existing methods in experiments on both synthetic and real data. The real data comes from hyperspectral imaging, video recordings, and a subset of the COIL-100 image dataset. Our method achieves substantial speedup---sometimes two or three orders of magnitude---over competing methods, while maintaining good accuracy.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers5
- Subquadratic Kronecker Regression with Applications to Tensor DecompositionMatthew Fahrbach, Gang Fu, Mehrdad GhadiriNeurIPS 2022 · 24 citations
- More Efficient Sampling for Tensor Decomposition With Worst-Case GuaranteesOsman Asif MalikICML 2022 · 17 citations
- Efficient Leverage Score Sampling for Tensor Train DecompositionVivek Bharadwaj, Beheshteh T. Rakhshan, Osman Asif Malik, Guillaume RabusseauNeurIPS 2024 · 7 citations
- Many-body Approximation for Non-negative TensorsKazu Ghalamkari, Mahito Sugiyama, Yoshinobu KawaharaNeurIPS 2023 · 4 citations
- Fast Tensor Completion via Approximate Richardson IterationMehrdad Ghadiri, Matthew Fahrbach, Yunbum Kook, Ali JadbabaieICML 2025
Builds on1
Related papers
- Fast and accurate randomized algorithms for low-rank tensor decompositionsLinjian Ma, Edgar SolomonikNeurIPS 2021 · 35 citations
- Fast Exact Leverage Score Sampling from Khatri-Rao Products with Applications to Tensor DecompositionVivek Bharadwaj, Osman Asif Malik, Riley Murray, Laura Grigori et al.NeurIPS 2023 · 14 citations
- Fast and Provable Nonconvex Tensor RPCAHaiquan Qiu, Yao Wang, Shaojie Tang, Deyu Meng et al.ICML 2022 · 10 citations
- Towards Efficient Tensor Decomposition-Based DNN Model Compression With Optimization FrameworkMiao Yin, Yang Sui, Siyu Liao, Bo YuanCVPR 2021
- TRT: Harnessing Tensor Ring Transformer for Hyperspectral Image Super-ResolutionHonghui Xu, Junwei Zhu, Yubin Gu, Yueqian Quan et al.AAAI 2026
