Fair-Count-Min: Frequency Estimation under Equal Group-wise Approximation Factor
Nima Shahbazi, Stavros Sintos, Abolfazl Asudeh
Abstract
Frequency estimation in streaming data often relies on sketches like Count-Min to provide approximate answers with sublinear space. However, Count-Min sketches introduce additive errors that disproportionately impact the unpopular groups, creating fairness concerns. To address these concerns, we introduce Fair-Count-Min, a frequency estimation sketch that guarantees equal expected approximation factors across various groups. We propose a column partitioning approach with group-aware semi-uniform hashing to eliminate collisions between elements from different groups. We provide theoretical guarantees for fairness, analyze its associated cost, and validate our findings through extensive experiments on real-world datasets in comparison with representative state-of-the-art baselines. Our experimental results demonstrate that Fair-Count-Min achieves fairness with generally small additional error while maintaining efficiency comparable to that of the Count-Min sketch.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 01865464-4d1b-4daa-a489-2e5f01b3174dBuilds on13
- Fairness-aware Task Assignment in Spatial Crowdsourcing: Game-Theoretic ApproachesYan Zhao, Kai Zheng, Jiannan Guo, Bin Yang et al.ICDE 2021 · 81 citations
- Fair Hierarchical ClusteringSara Ahmadian, Alessandro Epasto, Marina Knittel, Ravi Kumar et al.NeurIPS 2020 · 61 citations
- Tailoring Data Source Distributions for Fairness-aware Data IntegrationFatemeh Nargesian, Abolfazl Asudeh, H. V. JagadishVLDB 2021 · 51 citations
- Identifying Insufficient Data Coverage for Ordinal Continuous-Valued AttributesAbolfazl Asudeh, Nima Shahbazi, Zhongjun Jin, H. V. JagadishSIGMOD 2021 · 30 citations
- Approximation Algorithms for Fair Range ClusteringSèdjro Salomon Hotegni, Sepideh Mahabadi, Ali VakilianICML 2023 · 25 citations
Related papers
- Frequency Estimation with One-Sided ErrorPiotr Indyk, Shyam Narayanan, David P. WoodruffSODA 2022 · 1 citation
- MimoSketch: A Framework to Mine Item Frequency on Multiple Nodes with SketchesYuchen Xu, Wenfei Wu, Bohan Zhao, Tong Yang et al.KDD 2023 · 5 citations
- Sublime: Sublinear Error & Space for Unbounded Skewed StreamsNavid Eslami, Ioana O. Bercea, Rasmus Pagh, Niv DayanSIGMOD 2026
- Improved Frequency Estimation Algorithms with and without PredictionsAnders Aamand, Justin Y. Chen, Huy Lê Nguyen, Sandeep Silwal et al.NeurIPS 2023 · 16 citations
- DISCO: A Dynamically Configurable Sketch Framework in Skewed Data StreamsJiaqian Liu, Ran Ben Basat, Louis De Wardt, Haipeng Dai et al.ICDE 2024 · 3 citations
