Submodular Maximization under Supermodular Constraint: Greedy Guarantees
Ajitesh Srivastava, Shanghua Teng
Abstract
Motivated by a wide range of applications in data mining and machine learning, we consider the problem of maximizing a submodular function subject to supermodular cost constraints. In contrast to the well-understood setting of cardinality and matroid constraints, where greedy algorithms admit strong guarantees, the supermodular constraint regime remains poorly understood -- guarantees for greedy methods and other efficient algorithmic paradigms are largely open. We study this family of fundamental optimization problems under an upper-bound constraint on a supermodular cost function with curvature parameter ?. Our notion of supermodular curvature is less restrictive than prior definitions, substantially expanding the class of admissible cost functions. We show that our greedy algorithm, which iteratively includes elements maximizing the ratio of the objective and constraint functions, achieves a (1 − e−(1−?))-approximation before stopping. We prove that this approximation is indeed tight for this algorithm. Further, if the objective function has a submodular curvature c, then we show that the bound further improves to (1 − (1 − (1 − c)(1 − ?))1/(1−c)), which can be further improved by continuing to violate the constraint. Finally, we show that the Greedy-Ratio-Marginal in conjunction with binary search leads to a bicriteria approximation for the dual problem -- minimizing a supermodular function under a lower bound constraint on a submodular function. We conduct a number of experiments on a simulation of LLM agents debating over multiple rounds -- the task is to select a subset of agents to maximize correctly answered questions. Our algorithm outperforms all other greedy heuristics, and on smaller problems, it achieves the same performance as the optimal set found by exhaustive search.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on7
- Improving Factuality and Reasoning in Language Models through Multiagent DebateYilun Du, Shuang Li, Antonio Torralba, Joshua B. Tenenbaum et al.ICML 2024 · 1,562 citations
- PRISM: A Rich Class of Parameterized Submodular Information Measures for Guided Data Subset SelectionSuraj Kothawade, Vishal Kaushal, Ganesh Ramakrishnan, Jeff A. Bilmes et al.AAAI 2022 · 66 citations
- Learning Interpretable Decision Rule Sets: A Submodular Optimization ApproachFan Yang, Kai He, Linxiao Yang, Hongxia Du et al.NeurIPS 2021 · 35 citations
- Densest Subgraph: Supermodularity, Iterative Peeling, and FlowChandra Chekuri, Kent Quanrud, Manuel R. TorresSODA 2022 · 34 citations
- Bicriteria Approximation Algorithms for the Submodular Cover ProblemWenjing Chen, Victoria G. CrawfordNeurIPS 2023 · 10 citations
Related papers
- Randomized Algorithms for Submodular Function Maximization with a k-System ConstraintShuang Cui, Kai Han, Tianshuai Zhu, Jing Tang et al.ICML 2021 · 17 citations
- An Efficient Framework for Balancing Submodularity and CostSofia Maria Nikolakaki, Alina Ene, Evimaria TerziKDD 2021 · 30 citations
- Discretely beyond 1/e: Guided Combinatorial Algortihms for Submodular MaximizationYixin Chen, Ankur Nath, Chunli Peng, Alan KuhnleNeurIPS 2024 · 8 citations
- Using Partial Monotonicity in Submodular MaximizationLoay Mualem, Moran FeldmanNeurIPS 2022 · 13 citations
- Unconstrained Submodular Maximization with Modular Costs: Tight Approximation and Application to Profit MaximizationTianyuan Jin, Yu Yang, Renchi Yang, Jieming Shi et al.VLDB 2021 · 31 citations
