AeroSketch: Near-Optimal Time Matrix Sketch Framework for Persistent, Sliding Window, and Distributed Streams
Hanyan Yin, Dongxie Wen, Jiajun Li, Zhewei Wei, Xiao Zhang, Peng Zhao, Zhi-Hua Zhou
摘要
Many real-world matrix datasets arrive as high-throughput vector streams, making it impractical to store or process them in their entirety. To enable real-time analytics under limited computational, memory, and communication resources, matrix sketching techniques have been developed over recent decades to provide compact approximations of such streaming data. Some algorithms have achieved optimal space and communication complexity. However, these approaches often require frequent time-consuming matrix factorization operations. In particular, under tight approximation error bounds, each matrix factorization computation incurs cubic time complexity, thereby limiting their update efficiency. In this paper, we introduce AeroSketch, a novel matrix sketching framework that leverages recent advances in randomized numerical linear algebra (RandNLA). AeroSketch achieves optimal communication and space costs while delivering near-optimal update time complexity (within logarithmic factors) across persistent, sliding window, and distributed streaming scenarios. Extensive experiments on both synthetic and real-world datasets demonstrate that AeroSketch consistently outperforms state-of-the-art methods in update throughput. In particular, under tight approximation error constraints, AeroSketch reduces the cubic time complexity to the quadratic level. Meanwhile, it maintains comparable approximation quality while retaining optimal communication and space costs.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper7
- TEA: Enabling State-Intensive Network Functions on Programmable SwitchesDaehyeok Kim, Zaoxing Liu, Yibo Zhu, Changhoon Kim 等SIGCOMM 2020 · 被引用 121 次
- At-the-time and Back-in-time Persistent SketchesBenwei Shi, Zhuoyue Zhao, Yanqing Peng, Feifei Li 等SIGMOD 2021 · 被引用 15 次
- Optimal Matrix Sketching over Sliding WindowsHanyan Yin, Dongxie Wen, Jiajun Li, Zhewei Wei 等VLDB 2024 · 被引用 5 次
- Learning with Adaptive Resource AllocationJing Wang, Miao Yu, Peng Zhao, Zhi-Hua ZhouICML 2024 · 被引用 3 次
- Approximate Matrix Multiplication over Sliding WindowsZiqi Yao, Lianzhi Li, Mingsong Chen, Xian Wei 等KDD 2024 · 被引用 2 次
相关 Paper
- Distributed Least Squares in Small Space via Sketching and Bias ReductionSachin Garg, Kevin Tan, Michal DerezinskiNeurIPS 2024 · 被引用 5 次
- Revisiting Co-Occurring Directions: Sharper Analysis and Efficient Algorithm for Sparse MatricesLuo Luo, Cheng Chen, Guangzeng Xie, Haishan YeAAAI 2021 · 被引用 4 次
- Tight Bounds for the Subspace Sketch Problem with ApplicationsYi Li, Ruosong Wang, David P. WoodruffSODA 2020 · 被引用 5 次
- Tensor-Based Sketching Method for the Low-Rank Approximation of Data StreamsCuiyu Liu, Chuanfu Xiao, Mingshuo Ding, Chao YangICLR 2023
- Fast concurrent data sketchesArik Rinberg, Alexander Spiegelman, Edward Bortnikov, Eshcar Hillel 等PPoPP 2020 · 被引用 4 次
