NeurIPS2021
Logarithmic Regret from Sublinear Hints
Aditya Bhaskara, Ashok Cutkosky, Ravi Kumar, Manish Purohit
19 citations
Abstract
We consider the online linear optimization problem, where at every step the algorithm plays a point in the unit ball, and suffers loss for some cost vector that is then revealed to the algorithm. Recent work showed that if an algorithm receives a hint that has non-trivial correlation with before it plays , then it can achieve a regret guarantee of , improving on the bound of in the standard setting. In this work, we study the question of whether an algorithm really requires a hint at every time step. Somewhat surprisingly, we show that an algorithm can obtain regret with just hints under a natural query model; in contrast, we also show that hints cannot guarantee better than regret. We give two applications of our result, to the well-studied setting of optimistic regret bounds and to the problem of online learning with abstention.