A generalization of the randomized singular value decomposition
Nicolas Boullé, Alex Townsend
Abstract
The randomized singular value decomposition (SVD) is a popular and effective algorithm for computing a near-best rank approximation of a matrix using matrix-vector products with standard Gaussian vectors. Here, we generalize the randomized SVD to multivariate Gaussian vectors, allowing one to incorporate prior knowledge of into the algorithm. This enables us to explore the continuous analogue of the randomized SVD for Hilbert--Schmidt (HS) operators using operator-function products with functions drawn from a Gaussian process (GP). We then construct a new covariance kernel for GPs, based on weighted Jacobi polynomials, which allows us to rapidly sample the GP and control the smoothness of the randomly generated functions. Numerical examples on matrices and HS operators demonstrate the applicability of the algorithm.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on1
Related papers
- Kernel Quadrature with Randomly Pivoted CholeskyEthan Epperly, Elvira MorenoNeurIPS 2023 · 16 citations
- Optimal Randomized First-Order Methods for Least-Squares ProblemsJonathan Lacotte, Mert PilanciICML 2020 · 30 citations
- Block Subsampled Randomized Hadamard Transform for Nyström Approximation on Distributed ArchitecturesOleg Balabanov, Matthias Beaupère, Laura Grigori, Victor LedererICML 2023 · 13 citations
- Sampling-based Nyström Approximation and Kernel QuadratureSatoshi Hayakawa, Harald Oberhauser, Terry J. LyonsICML 2023 · 20 citations
- Error Estimation for Sketched SVD via the BootstrapMiles E. Lopes, N. Benjamin Erichson, Michael W. MahoneyICML 2020 · 12 citations
