Submodular Function Minimization with Dueling Oracle
Huaiyuan Xiao, Shinji Ito
摘要
We consider submodular function minimization using a dueling oracle, a noisy pairwise comparison oracle that provides relative feedback on function values between two queried sets. The oracle's responses are governed by a transfer function, which characterizes the relationship between differences in function values and the parameters of the response distribution. For a linear transfer function, we propose an algorithm that achieves an error rate of O(n where n is the size of the ground set and T denotes the number of oracle calls. We establish a lower bound: Under the constraint that differences between queried sets are bounded by a constant, any algorithm incurs an error of at least Ω(n Without such a constraint, the lower bound becomes Ω(n/ √ T ). These results show that our algorithm is optimal up to constant factors for constrained algorithms. For a sigmoid transfer function, we design an algorithm with an error rate of O(n 7 5 /T 2 5 ), and establish lower bounds analogous to the linear case. 1 INTRODUCTION Let f be a set function defined on subsets of a finite set [n] = 1, • • • , n. A function f is called submodular if it satisfies f (X) + f (Y ) ≥ f (X ∪ Y ) + f (X ∩ Y ) for all X, Y ⊆ [n].
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning 等NeurIPS 2023 · 被引用 10,924 次
- Principled Reinforcement Learning with Human Feedback from Pairwise or K-wise ComparisonsBanghua Zhu, Michael I. Jordan, Jiantao JiaoICML 2023 · 被引用 273 次
- Learning to summarize with human feedbackNisan Stiennon, Long Ouyang, Jeffrey Wu, Daniel M. Ziegler 等NeurIPS 2020 · 被引用 124 次
- LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative FusionDongfu Jiang, Xiang Ren, Bill Yuchen LinACL 2023 · 被引用 95 次
- Adversarial Dueling BanditsAadirupa Saha, Tomer Koren, Yishay MansourICML 2021 · 被引用 35 次
相关 Paper
- Dueling Convex Optimization with General PreferencesAadirupa Saha, Tomer Koren, Yishay MansourICML 2025
- Improved Lower Bounds for Submodular Function MinimizationDeeparnab Chakrabarty, Andrei Graur, Haotian Jiang, Aaron SidfordFOCS 2022 · 被引用 2 次
- A Unified Approach to Submodular Maximization Under NoiseKshipra Bhawalkar, Yang Cai, Zhe Feng, Christopher Liaw 等NeurIPS 2025 · 被引用 2 次
- Smooth Convex Optimization Using Sub-Zeroth-Order OraclesMustafa O. Karabag, Cyrus Neary, Ufuk TopcuAAAI 2021 · 被引用 7 次
- Near-optimal Approximate Discrete and Continuous Submodular Function MinimizationBrian Axelrod, Yang P. Liu, Aaron SidfordSODA 2020 · 被引用 14 次
