Submodular Maximization in Clean Linear Time
Wenxin Li, Moran Feldman, Ehsan Kazemi, Amin Karbasi
Abstract
In this paper, we provide the first deterministic algorithm that achieves the tight approximation guarantee for submodular maximization under a cardinality (size) constraint while making a number of queries that scales only linearly with the size of the ground set . To complement our result, we also show strong information-theoretic lower bounds. More specifically, we show that when the maximum cardinality allowed for a solution is constant, no algorithm making a sub-linear number of function evaluations can guarantee any constant approximation ratio. Furthermore, when the constraint allows the selection of a constant fraction of the ground set, we show that any algorithm making fewer than function evaluations cannot perform better than an algorithm that simply outputs a uniformly random subset of the ground set of the right size. We then provide a variant of our deterministic algorithm for the more general knapsack constraint, which is the first linear-time algorithm that achieves -approximation guarantee for this constraint. Finally, we extend our results to the general case of maximizing a monotone submodular function subject to the intersection of a -set system and multiple knapsack constraints. We extensively evaluate the performance of our algorithms on multiple real-life machine learning applications, including movie recommendation, location summarization, twitter text summarization and video summarization.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8c4d86c3-5ec7-407b-afcd-98db126afcd7Cited by top-tier papers10
- Data-Efficient Structured Pruning via Submodular OptimizationMarwa El Halabi, Suraj Srinivas, Simon Lacoste-JulienNeurIPS 2022 · 31 citations
- Keypoint-based Progressive Chain-of-Thought Distillation for LLMsKaituo Feng, Changsheng Li, Xiaolu Zhang, Jun Zhou et al.ICML 2024 · 20 citations
- A Framework for Adapting Offline Algorithms to Solve Combinatorial Multi-Armed Bandit Problems with Bandit FeedbackGuanyu Nie, Yididiya Y. Nadew, Yanhui Zhu, Vaneet Aggarwal et al.ICML 2023 · 17 citations
- Deterministic Algorithm and Faster Algorithm for Submodular Maximization Subject to a Matroid ConstraintNiv Buchbinder, Moran FeldmanFOCS 2024 · 11 citations
- Practical 0.385-Approximation for Submodular Maximization Subject to a Cardinality ConstraintMurad Tukan, Loay Mualem, Moran FeldmanNeurIPS 2024 · 9 citations
Builds on6
- Coresets for Data-efficient Training of Machine Learning ModelsBaharan Mirzasoleiman, Jeff A. Bilmes, Jure LeskovecICML 2020 · 494 citations
- Streaming Submodular Maximization under a k-Set System ConstraintRan Haba, Ehsan Kazemi, Moran Feldman, Amin KarbasiICML 2020 · 43 citations
- Regularized Submodular Maximization at ScaleEhsan Kazemi, Shervin Minaee, Moran Feldman, Amin KarbasiICML 2021 · 41 citations
- The one-way communication complexity of submodular maximization with applications to streaming and robustnessMoran Feldman, Ashkan Norouzi-Fard, Ola Svensson, Rico ZenklusenSTOC 2020 · 32 citations
- Near-Optimal Multi-Perturbation Experimental Design for Causal Structure LearningScott Sussex, Caroline Uhler, Andreas KrauseNeurIPS 2021 · 24 citations
Related papers
- Submodular Maximization Through Barrier FunctionsAshwinkumar Badanidiyuru, Amin Karbasi, Ehsan Kazemi, Jan VondrákNeurIPS 2020 · 22 citations
- Approximation Algorithms for Size-Constrained Non-Monotone Submodular Maximization in Deterministic Linear TimeYixin Chen, Alan KuhnleKDD 2023 · 5 citations
- Dynamic Submodular MaximizationMorteza MonemizadehNeurIPS 2020 · 13 citations
- Practical Parallel Algorithms for Submodular Maximization Subject to a Knapsack Constraint with Nearly Optimal AdaptivityShuang Cui, Kai Han, Jing Tang, He Huang et al.AAAI 2023 · 8 citations
- Deletion-Robust Submodular Maximization with Knapsack ConstraintsShuang Cui, Kai Han, He HuangAAAI 2024 · 3 citations
