No Dimensional Sampling Coresets for Classification
Meysam Alishahi, Jeff M. Phillips
Abstract
We refine and generalize what is known about coresets for classification problems via the sensitivity sampling framework. Such coresets seek the smallest possible subsets of input data, so one can optimize a loss function on the coreset and ensure approximation guarantees with respect to the original data. Our analysis provides the first no dimensional coresets, so the size does not depend on the dimension. Moreover, our results are general, apply for distributional input and can use iid samples, so provide sample complexity bounds, and work for a variety of loss functions. A key tool we develop is a Radamacher complexity version of the main sensitivity sampling approach, which can be of independent interest.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 65367a79-7a21-469d-b6d3-90e2da305218Cited by top-tier papers1
Ask how each one uses itBuilds on7
- Coresets for Data-efficient Training of Machine Learning ModelsBaharan Mirzasoleiman, Jeff A. Bilmes, Jure LeskovecICML 2020 · 494 citations
- Data-Independent Neural Pruning via CoresetsBen Mussay, Margarita Osadchy, Vladimir Braverman, Samson Zhou et al.ICLR 2020 · 65 citations
- Coresets for Classification - Simplified and StrengthenedTung Mai, Cameron Musco, Anup RaoNeurIPS 2021 · 39 citations
- Coresets for clustering in Euclidean spaces: importance sampling is nearly optimalLingxiao Huang, Nisheeth K. VishnoiSTOC 2020 · 36 citations
- Oblivious Sketching for Logistic RegressionAlexander Munteanu, Simon Omlor, David P. WoodruffICML 2021 · 23 citations
Related papers
- Coresets for Near-Convex FunctionsMurad Tukan, Alaa Maalouf, Dan FeldmanNeurIPS 2020 · 49 citations
- Sensitivity Sampling for k-Means: Worst Case and Stability Optimal Coreset BoundsNikhil Bansal, Vincent Cohen-Addad, Milind Prabhu, David Saulpic et al.FOCS 2024 · 2 citations
- Tight Sensitivity Bounds For Smaller CoresetsAlaa Maalouf, Adiel Statman, Dan FeldmanKDD 2020 · 11 citations
- Settling Time vs. Accuracy Tradeoffs for Clustering Big DataAndrew Draganov, David Saulpic, Chris SchwiegelshohnSIGMOD 2024 · 3 citations
- Generic Coreset for Scalable Learning of Monotonic Kernels: Logistic Regression, Sigmoid and moreElad Tolochinsky, Ibrahim Jubran, Dan FeldmanICML 2022 · 19 citations
