No-Regret Online Prediction with Strategic Experts
Omid Sadeghi, Maryam Fazel
Abstract
We study a generalization of the online binary prediction with expert advice framework where at each round, the learner is allowed to pick experts from a pool of experts and the overall utility is a modular or submodular function of the chosen experts. We focus on the setting in which experts act strategically and aim to maximize their influence on the algorithm's predictions by potentially misreporting their beliefs about the events. Among others, this setting finds applications in forecasting competitions where the learner seeks not only to make predictions by aggregating different forecasters but also to rank them according to their relative performance. Our goal is to design algorithms that satisfy the following two requirements: 1) : Incentivize the experts to report their beliefs truthfully, and 2) : Achieve sublinear regret with respect to the true beliefs of the best fixed set of experts in hindsight. Prior works have studied this framework when and provided incentive-compatible no-regret algorithms for the problem. We first show that a simple reduction of our problem to the setting is neither efficient nor effective. Then, we provide algorithms that utilize the specific structure of the utility functions to achieve the two desired goals.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3b1b9e9b-d55b-49c7-8174-29dafcc58c25Builds on2
- No-Regret and Incentive-Compatible Online LearningRupert Freeman, David M. Pennock, Chara Podimata, Jennifer Wortman VaughanICML 2020 · 19 citations
- Improved Algorithms for Online Submodular Maximization via First-order Regret BoundsNicholas J. A. Harvey, Christopher Liaw, Tasuku SomaNeurIPS 2020 · 17 citations
Related papers
- Adaptive Selective Sampling for Online Prediction with ExpertsRui M. Castro, Fredrik Hellström, Tim van ErvenNeurIPS 2023 · 4 citations
- No-Regret Learning with Unbounded Losses: The Case of Logarithmic PoolingEric Neyman, Tim RoughgardenNeurIPS 2023 · 10 citations
- Online Allocation and Learning in the Presence of Strategic AgentsSteven Yin, Shipra Agrawal, Assaf ZeeviNeurIPS 2022 · 3 citations
- Hedging and Approximate Truthfulness in Traditional Forecasting CompetitionsMary Monroe, Anish Thilagar, Melody Hsu, Rafael M. FrongilloAAAI 2025 · 1 citation
- Online Information Acquisition: Hiring Multiple AgentsFederico Cacciamani, Matteo Castiglioni, Nicola GattiICLR 2024 · 3 citations
