Optimal Eigenvalue Approximation via Sketching
William Swartworth, David P. Woodruff
Abstract
Given a symmetric matrix A, we show from the simple sketch GAG T , where G is a Gaussian matrix with k = O(1/ǫ 2 ) rows, that there is a procedure for approximating all eigenvalues of A simultaneously to within ǫ A F additive error with large probability. Unlike the work of (Andoni, Nguyen, SODA, 2013), we do not require that A is positive semidefinite and therefore we can recover sign information about the spectrum as well. Our result also significantly improves upon the sketching dimension of recent work for this problem (Needell, Swartworth, Woodruff FOCS 2022), and in fact gives optimal sketching dimension. Our proof develops new properties of singular values of GA for a k × n Gaussian matrix G and an n × n matrix A which may be of independent interest. Additionally we achieve tight bounds in terms of matrix-vector queries. Our sketch can be computed using O(1/ǫ 2 ) matrix-vector multiplies, and by improving on lower bounds for the so-called rank estimation problem, we show that this number is optimal even for adaptive matrix-vector queries.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers7
- Scaling Laws in Linear Regression: Compute, Parameters, and DataLicong Lin, Jingfeng Wu, Sham M. Kakade, Peter L. Bartlett et al.NeurIPS 2024 · 57 citations
- Efficient Sketches for Training Data Attribution and Studying the Loss LandscapeAndrea SchioppaNeurIPS 2024 · 11 citations
- Improved Spectral Density Estimation via Explicit and Implicit DeflationRajarshi Bhattacharjee, Rajesh Jayaram, Cameron Musco, Christopher Musco et al.SODA 2025 · 1 citation
- Lifting Linear Sketches: Optimal Bounds and Adversarial RobustnessElena Gribelyuk, Honghao Lin, David P. Woodruff, Huacheng Yu et al.STOC 2025 · 1 citation
- Even Faster Kernel Matrix Linear Algebra via Density EstimationRikhav Shah, Sandeep Silwal, Haike XuICML 2026 · 1 citation
Builds on5
- Optimal Sketching for Trace EstimationShuli Jiang, Hai Pham, David P. Woodruff, Qiuyi (Richard) ZhangNeurIPS 2021 · 28 citations
- Optimal Query Complexities for Dynamic Trace EstimationDavid P. Woodruff, Fred Zhang, Richard ZhangNeurIPS 2022 · 13 citations
- Sublinear time spectral density estimationVladimir Braverman, Aditya Krishnan, Christopher MuscoSTOC 2022 · 9 citations
- Testing Positive Semi-Definiteness via Random SubmatricesAinesh Bakshi, Nadiia Chepurko, Rajesh JayaramFOCS 2020 · 8 citations
- Testing Positive Semidefiniteness Using Linear MeasurementsDeanna Needell, William Swartworth, David P. WoodruffFOCS 2022 · 4 citations
Related papers
- Tight Sampling Bounds for Eigenvalue ApproximationWilliam Swartworth, David P. WoodruffSODA 2025
- Faster Linear Systems and Matrix Norm Approximation via Multi-level Sketched PreconditioningMichal Derezinski, Christopher Musco, Jiaming YangSODA 2025
- Precise expressions for random projections: Low-rank approximation and randomized NewtonMichal Derezinski, Feynman T. Liang, Zhenyu Liao, Michael W. MahoneyNeurIPS 2020 · 26 citations
- Understanding the Kronecker Matrix-Vector Complexity of Linear AlgebraRaphael A. Meyer, William J. Swartworth, David P. WoodruffICML 2025
- Near-Optimal Algorithms for Linear Algebra in the Current Matrix Multiplication TimeNadiia Chepurko, Kenneth L. Clarkson, Praneeth Kacham, David P. WoodruffSODA 2022 · 3 citations
