Fast Deterministic CUR Matrix Decomposition with Accuracy Assurance
Yasutoshi Ida, Sekitoshi Kanai, Yasuhiro Fujiwara, Tomoharu Iwata, Koh Takeuchi, Hisashi Kashima
Abstract
The deterministic CUR matrix decomposition is a low-rank approximation method to analyze a data matrix. It has attracted considerable attention due to its high interpretability, which results from the fact that the decomposed matrices consist of subsets of the original columns and rows of the data matrix. The subset is obtained by optimizing an objective function with sparsity-inducing norms via coordinate descent. However, the existing algorithms for optimization incur high computation costs. This is because coordinate descent iteratively updates all the parameters in the objective until convergence. This paper proposes a fast deterministic CUR matrix decomposition. Our algorithm safely skips unnecessary updates by efficiently evaluating the optimality conditions for the parameters to be zeros. In addition, we preferentially update the parameters that must be nonzeros. Theoretically, our approach guarantees the same result as the original approach. Experiments demonstrate that our algorithm speeds up the deterministic CUR while achieving the same accuracy.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fffa9f37-c21a-4dca-addd-b822e1b4efdbCited by top-tier papers3
- Fast Algorithm for Anchor Graph HashingYasuhiro Fujiwara, Sekitoshi Kanai, Yasutoshi Ida, Atsutoshi Kumagai et al.VLDB 2021 · 4 citations
- Fast Regularized Discrete Optimal Transport with Group-Sparse RegularizersYasutoshi Ida, Sekitoshi Kanai, Kazuki Adachi, Atsutoshi Kumagai et al.AAAI 2023 · 3 citations
- Fast Iterative Hard Thresholding Methods with Pruning Gradient ComputationsYasutoshi Ida, Sekitoshi Kanai, Atsutoshi Kumagai, Tomoharu Iwata et al.NeurIPS 2024 · 3 citations
Related papers
- Large-Scale Learning with Fourier Features and Tensor DecompositionsFrederiek Wesel, Kim BatselierNeurIPS 2021 · 20 citations
- Few-Shot Data-Driven Algorithms for Low Rank ApproximationPiotr Indyk, Tal Wagner, David P. WoodruffNeurIPS 2021 · 12 citations
- A Block Decomposition Algorithm for Sparse OptimizationGanzhao Yuan, Li Shen, Wei-Shi ZhengKDD 2020 · 11 citations
- Efficient Robust Principal Component Analysis via Block Krylov Iteration and CUR DecompositionShun Fang, Zhengqin Xu, Shiqian Wu, Shoulie XieCVPR 2023
- Solving Dense Linear Systems Faster Than via PreconditioningMichal Derezinski, Jiaming YangSTOC 2024
