Robust Linear Dueling Bandits with Post-serving Context under Unknown Delays and Adversarial Corruptions
Youngmin Oh
摘要
We study linear dueling bandits in volatile environments characterized by the simultaneous presence of post-serving contexts, delayed feedback, and adversarial corruption. Feedback is subject to unknown stochastic or adversarial delays and a cumulative corruption budget . To address these challenges, we propose RCDP-UCB, which integrates a learned approximator that predicts post-serving contexts from pre-serving information. It further employs an adaptive weighting strategy that clips feature vectors to mitigate the impact of corrupted and delayed observations simultaneously. Under standard regularity conditions and a parametric post-serving mapping, we rigorously establish that our algorithm is delay-regime-agnostic, achieving a regret upper bound of , where is the total feature dimension and encapsulates the delay complexity, scaling with under adversarial delays or under stochastic delays (: cumulative delay budget; : mean of sub-Gaussian delays). We further establish lower bounds that nearly match our upper bounds up to a factor for adversarial delays in the absence of post-serving contexts. Code is available at https://github.com/youngmin0oh/rcdp-public.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper15
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida 等NeurIPS 2022 · 被引用 24,707 次
- Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning 等NeurIPS 2023 · 被引用 10,924 次
- Linear bandits with Stochastic Delayed FeedbackClaire Vernade, Alexandra Carpentier, Tor Lattimore, Giovanni Zappella 等ICML 2020 · 被引用 74 次
- Nearly Optimal Algorithms for Linear Contextual Bandits with Adversarial CorruptionsJiafan He, Dongruo Zhou, Tong Zhang, Quanquan GuNeurIPS 2022 · 被引用 66 次
- Optimal Algorithms for Stochastic Contextual Preference BanditsAadirupa SahaNeurIPS 2021 · 被引用 64 次
相关 Paper
- Corruption-Robust Algorithms with Uncertainty Weighting for Nonlinear Contextual Bandits and Markov Decision ProcessesChenlu Ye, Wei Xiong, Quanquan Gu, Tong ZhangICML 2023 · 被引用 40 次
- Logarithmic Regret for Linear Markov Decision Processes with Adversarial CorruptionsCanzhe Zhao, Xiangcheng Zhang, Baoxiang Wang, Shuai LiAAAI 2025 · 被引用 1 次
- Improved Best-of-Both-Worlds Regret for Bandits with Delayed FeedbackOfir Schlisselberg, Tal Lancewicki, Peter Auer, Yishay MansourNeurIPS 2025 · 被引用 2 次
- Nearly Optimal Algorithms for Contextual Dueling Bandits from Adversarial FeedbackQiwei Di, Jiafan He, Quanquan GuICML 2025
- Adversarial Bandits with Corruptions: Regret Lower Bound and No-regret AlgorithmLin Yang, Mohammad Hassan Hajiesmaili, Mohammad Sadegh Talebi, John C. S. Lui 等NeurIPS 2020 · 被引用 39 次
