An active learning framework for multi-group mean estimation

We study a fundamental learning problem over multiple groups with unknown data distributions, where an analyst would like to learn the mean of each group. Moreover, we want to ensure that this data is collected in a relatively fair manner such that the noise of the estimate of each group is reasonable. In particular, we focus on settings where data are collected dynamically, which is important in adaptive experimentation for online platforms or adaptive clinical trials for healthcare. In our model, we employ an active learning framework to sequentially collect samples with bandit feedback, observing a sample in each period from the chosen group. After observing a sample, the analyst updates their estimate of the mean and variance of that group and chooses the next group accordingly. The analyst's objective is to dynamically collect samples to minimize the collective noise of the estimators, measured by the norm of the vector of variances of the mean estimators. We propose an algorithm, Variance-UCB, that sequentially selects groups according to an upper confidence bound on the variance estimate. We provide a general theoretical framework for providing efficient bounds on learning from any underlying distribution where the variances can be estimated reasonably. This framework yields upper bounds on regret that improve significantly upon all existing bounds, as well as a collection of new results for different objectives and distributions than those previously studied. Nature of feedback Reference Additional information Leading regret term Bounded Antos et al. (2008) support [a, b] C(b-a) 2 ∥σ∥ 2 G 2 log 2 GT σ 2 min √ T , C ≫ 1 Sub-Gaussian Carpentier et al. (2011) Upper bound s ≥ ∥σ∥ ∞ 7.6 × 10 5 s 2 σ 2 min G 2 log 2 T √ T Our paper (Theorem 5.1) Upper bound ĉ ≥ σ 4 √ 3 ∥ĉ∥ 2 ∥σ∥ 2 G log T T Gaussian Carpentier et al. (2011) Upper bound Σ ≥ ∥σ∥ 2 2