AeroSketch: Near-Optimal Time Matrix Sketch Framework for Persistent, Sliding Window, and Distributed Streams
Hanyan Yin, Dongxie Wen, Jiajun Li, Zhewei Wei, Xiao Zhang, Peng Zhao, Zhi-Hua Zhou
Abstract
Many real-world matrix datasets arrive as high-throughput vector streams, making it impractical to store or process them in their entirety. To enable real-time analytics under limited computational, memory, and communication resources, matrix sketching techniques have been developed over recent decades to provide compact approximations of such streaming data. Some algorithms have achieved optimal space and communication complexity. However, these approaches often require frequent time-consuming matrix factorization operations. In particular, under tight approximation error bounds, each matrix factorization computation incurs cubic time complexity, thereby limiting their update efficiency. In this paper, we introduce AeroSketch, a novel matrix sketching framework that leverages recent advances in randomized numerical linear algebra (RandNLA). AeroSketch achieves optimal communication and space costs while delivering near-optimal update time complexity (within logarithmic factors) across persistent, sliding window, and distributed streaming scenarios. Extensive experiments on both synthetic and real-world datasets demonstrate that AeroSketch consistently outperforms state-of-the-art methods in update throughput. In particular, under tight approximation error constraints, AeroSketch reduces the cubic time complexity to the quadratic level. Meanwhile, it maintains comparable approximation quality while retaining optimal communication and space costs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 50a6d83e-89cd-48f3-b390-13846bb21aadBuilds on7
- TEA: Enabling State-Intensive Network Functions on Programmable SwitchesDaehyeok Kim, Zaoxing Liu, Yibo Zhu, Changhoon Kim et al.SIGCOMM 2020 · 121 citations
- At-the-time and Back-in-time Persistent SketchesBenwei Shi, Zhuoyue Zhao, Yanqing Peng, Feifei Li et al.SIGMOD 2021 · 15 citations
- Optimal Matrix Sketching over Sliding WindowsHanyan Yin, Dongxie Wen, Jiajun Li, Zhewei Wei et al.VLDB 2024 · 5 citations
- Learning with Adaptive Resource AllocationJing Wang, Miao Yu, Peng Zhao, Zhi-Hua ZhouICML 2024 · 3 citations
- Approximate Matrix Multiplication over Sliding WindowsZiqi Yao, Lianzhi Li, Mingsong Chen, Xian Wei et al.KDD 2024 · 2 citations
Related papers
- Distributed Least Squares in Small Space via Sketching and Bias ReductionSachin Garg, Kevin Tan, Michal DerezinskiNeurIPS 2024 · 5 citations
- Revisiting Co-Occurring Directions: Sharper Analysis and Efficient Algorithm for Sparse MatricesLuo Luo, Cheng Chen, Guangzeng Xie, Haishan YeAAAI 2021 · 4 citations
- Tight Bounds for the Subspace Sketch Problem with ApplicationsYi Li, Ruosong Wang, David P. WoodruffSODA 2020 · 5 citations
- Tensor-Based Sketching Method for the Low-Rank Approximation of Data StreamsCuiyu Liu, Chuanfu Xiao, Mingshuo Ding, Chao YangICLR 2023
- Fast concurrent data sketchesArik Rinberg, Alexander Spiegelman, Edward Bortnikov, Eshcar Hillel et al.PPoPP 2020 · 4 citations
