No-Regret and Incentive-Compatible Online Learning
Rupert Freeman, David M. Pennock, Chara Podimata, Jennifer Wortman Vaughan
摘要
We study online learning settings in which experts act strategically to maximize their influence on the learning algorithm's predictions by potentially misreporting their beliefs about a sequence of binary events. Our goal is twofold. First, we want the learning algorithm to be no-regret with respect to the best fixed expert in hindsight. Second, we want incentive compatibility, a guarantee that each expert's best strategy is to report his true beliefs about the realization of each event. To achieve this goal, we build on the literature on wagering mechanisms, a type of multi-agent scoring rule. We provide algorithms that achieve no regret and incentive compatibility for myopic experts for both the full and partial information settings. In experiments on datasets from FiveThirtyEight, our algorithms have regret comparable to classic no-regret algorithms, which are not incentive-compatible. Finally, we identify an incentive-compatible algorithm for forward-looking strategic agents that exhibits diminishing regret in practice.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper4
- Information Discrepancy in Strategic LearningYahav Bechavod, Chara Podimata, Zhiwei Steven Wu, Juba ZianiICML 2022 · 被引用 57 次
- PRODuctive bandits: Importance Weighting No MoreJulian Zimmert, Teodor Vanislavov MarinovNeurIPS 2024 · 被引用 5 次
- Strategic Linear Contextual BanditsThomas Kleine Buening, Aadirupa Saha, Christos Dimitrakakis, Haifeng XuNeurIPS 2024 · 被引用 4 次
- No-Regret Online Prediction with Strategic ExpertsOmid Sadeghi, Maryam FazelNeurIPS 2023 · 被引用 2 次
相关 Paper
- Online Information Acquisition: Hiring Multiple AgentsFederico Cacciamani, Matteo Castiglioni, Nicola GattiICLR 2024 · 被引用 3 次
- Online Mechanism Design for Information AcquisitionFederico Cacciamani, Matteo Castiglioni, Nicola GattiICML 2023 · 被引用 3 次
- Online Allocation and Learning in the Presence of Strategic AgentsSteven Yin, Shipra Agrawal, Assaf ZeeviNeurIPS 2022 · 被引用 3 次
- Online Learning in Betting Markets: Profit versus PredictionHaiqing Zhu, Alexander Soen, Yun Kuen Cheung, Lexing XieICML 2024 · 被引用 2 次
- Nash Incentive-compatible Online Mechanism Learning via Weakly Differentially Private Online LearningJoon Suk Huh, Kirthevasan KandasamyICML 2024 · 被引用 2 次
