Putting the "Learning" into Learning-Augmented Algorithms for Frequency Estimation
Elbert Du, Franklyn Wang, Michael Mitzenmacher
Abstract
In learning-augmented algorithms, algorithms are enhanced using information from a machine learning algorithm. In turn, this suggests that we should tailor our machine-learning approach for the target algorithm. We here consider this synergy in the context of the learned count-min sketch from (Hsu et al., 2019). Learning here is used to predict heavy hitters from a data stream, which are counted explicitly outside the sketch. We show that an approximately sufficient statistic for the performance of the underlying count-min sketch is given by the coverage of the predictor, or the normalized norm of keys that are filtered by the predictor to be explicitly counted. We show that machine learning models which are trained to optimize for coverage lead to large improvements in performance over prior approaches according to the average absolute frequency error. Our source code can be found at https://github.com/franklynwang/putting-the-learning-in-LAA.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers17
- Faster Fundamental Graph Algorithms via Learned PredictionsJustin Y. Chen, Sandeep Silwal, Ali Vakilian, Fred ZhangICML 2022 · 58 citations
- Learning Augmented Binary Search TreesHonghao Lin, Tian Luo, David P. WoodruffICML 2022 · 46 citations
- Learning Predictions for Algorithms with PredictionsMisha Khodak, Maria-Florina Balcan, Ameet Talwalkar, Sergei VassilvitskiiNeurIPS 2022 · 40 citations
- Algorithms with Prediction PortfoliosMichael Dinitz, Sungjin Im, Thomas Lavastida, Benjamin Moseley et al.NeurIPS 2022 · 33 citations
- Triangle and Four Cycle Counting with Predictions in Graph StreamsJustin Y. Chen, Talya Eden, Piotr Indyk, Honghao Lin et al.ICLR 2022 · 29 citations
Builds on6
- Accelerating Large-Scale Inference with Anisotropic Vector QuantizationRuiqi Guo, Philip Sun, Erik Lindgren, Quan Geng et al.ICML 2020 · 539 citations
- Near-Optimal Bounds for Online Caching with Machine Learned AdviceDhruv RohatgiSODA 2020 · 88 citations
- Learning-Augmented Data Stream AlgorithmsTanqiu Jiang, Yi Li, Honghao Lin, Yisong Ruan et al.ICLR 2020 · 53 citations
- Learning-based Support Estimation in Sublinear TimeTalya Eden, Piotr Indyk, Shyam Narayanan, Ronitt Rubinfeld et al.ICLR 2021 · 8 citations
- Adaptive Learned Bloom Filter (Ada-BF): Efficient Utilization of the Classifier with Application to Real-Time Information Filtering on the WebZhenwei Dai, Anshumali ShrivastavaNeurIPS 2020 · 7 citations
Related papers
- Improved Frequency Estimation Algorithms with and without PredictionsAnders Aamand, Justin Y. Chen, Huy Lê Nguyen, Sandeep Silwal et al.NeurIPS 2023 · 16 citations
- Learning-Augmented Frequent DirectionsAnders Aamand, Justin Y. Chen, Siddharth Gollapudi, Sandeep Silwal et al.ICLR 2025
- Composable Sketches for Functions of Frequencies: Beyond the Worst CaseEdith Cohen, Ofir Geri, Rasmus PaghICML 2020 · 17 citations
- Compact Frequency Estimators in Adversarial EnvironmentsSam A. Markelon, Mia Filic, Thomas ShrimptonCCS 2023 · 4 citations
- Bayesian Sketches for Volume Estimation in Data StreamsFrancesco Da Dalt, Simon Scherrer, Adrian PerrigVLDB 2023 · 5 citations
