Non-Convex Tensor Recovery from Local Measurements
Tongle Wu, Ying Sun, Jicong Fan
Abstract
Motivated by the settings where sensing the entire tensor is infeasible, this paper proposes a novel tensor compressed sensing model, where measurements are only obtained from sensing each lateral slice via mutually independent matrices. Leveraging the low tubal rank structure, we reparameterize the unknown tensor ?* using two compact tensor factors and formulate the recovery problem as a nonconvex minimization problem. To solve the problem, we first propose an alternating minimization algorithm, termed Alt-PGD-Min, that iteratively optimizes the two factors using a projected gradient descent and an exact minimization step, respectively. Despite nonconvexity, we prove that Alt-PGD-Min achieves ϵ-accuracy recovery with ?(?²log1/?) iteration complexity and ?(?⁶rn₃logn₃(?²r(n₁+n₂)+n₁log1/ε)) sample complexity, where ? denotes tensor condition number of ?*. To further accelerate the convergence, especially when the tensor is ill-conditioned with large ?, we prove Alt-ScalePGD-Min that preconditions the gradient update using an approximate Hessian that can be computed efficiently. We show that Alt-ScalePGD-Min achieves ? independent iteration complexity ?(log1/ε) and improves the sample complexity to ?(?⁴rn₃log n₃(?⁴ r(n₁ + n₂)+n₁log 1/ε)). Experiments validate the effectiveness of the proposed methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 19c5e9ae-8ac0-48fa-a2c5-ee741edda42eCited by top-tier papers2
- The Power of Small Initialization in Noisy Low-Tubal-Rank Tensor RecoveryZhiyu Liu, Haobo Geng, Xudong Wang, Yandong Tang et al.ICLR 2026 · 3 citations
- Non-Convex Tensor Recovery from Tube-Wise SensingTongle Wu, Ying SunNeurIPS 2025 · 1 citation
Builds on14
- Orthogonal Non-negative Tensor Factorization based Multi-view ClusteringJing Li, Quanxue Gao, Qianqian Wang, Ming Yang et al.NeurIPS 2023 · 73 citations
- Tensor Wheel Decomposition and Its Tensor Completion ApplicationZhong-Cheng Wu, Ting-Zhu Huang, Liang-Jian Deng, Hong-Xia Dou et al.NeurIPS 2022 · 62 citations
- Implicit Regularization in Tensor FactorizationNoam Razin, Asaf Maman, Nadav CohenICML 2021 · 60 citations
- Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural NetworksNoam Razin, Asaf Maman, Nadav CohenICML 2022 · 34 citations
- Transforms based Tensor Robust PCA: Corrupted Low-Rank Tensors Recovery via Convex OptimizationCanyi LuICCV 2021 · 29 citations
Related papers
- Tensor Completion Made PracticalAllen Liu, Ankur MoitraNeurIPS 2020 · 37 citations
- Fast and Provable Nonconvex Tensor RPCAHaiquan Qiu, Yao Wang, Shaojie Tang, Deyu Meng et al.ICML 2022 · 10 citations
- Preconditioning Matters: Fast Global Convergence of Non-convex Matrix Factorization via Scaled Gradient DescentXixi Jia, Hailin Wang, Jiangjun Peng, Xiangchu Feng et al.NeurIPS 2023 · 18 citations
- Fast and accurate randomized algorithms for low-rank tensor decompositionsLinjian Ma, Edgar SolomonikNeurIPS 2021 · 35 citations
- Guarantees for Alternating Least Squares in Overparameterized Tensor DecompositionsDionysis Arvanitakis, Vaidehi Srinivas, Aravindan VijayaraghavanNeurIPS 2025
