A Unifying Perspective on Multi-Calibration: Game Dynamics for Multi-Objective Learning
Nika Haghtalab, Michael I. Jordan, Eric Zhao
Abstract
We provide a unifying framework for the design and analysis of multicalibrated predictors. By placing the multicalibration problem in the general setting of multi-objective learning -- where learning guarantees must hold simultaneously over a set of distributions and loss functions -- we exploit connections to game dynamics to achieve state-of-the-art guarantees for a diverse set of multicalibration learning problems. In addition to shedding light on existing multicalibration guarantees and greatly simplifying their analysis, our approach also yields improved guarantees, such as obtaining stronger multicalibration conditions that scale with the square-root of group size and improving the complexity of -class multicalibration by an exponential factor of . Beyond multicalibration, we use these game dynamics to address emerging considerations in the study of group fairness and multi-distribution learning.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 37f166fa-75b5-4e54-b55a-763f861f7fefCited by top-tier papers12
- On-Demand Sampling: Learning Optimally from Multiple DistributionsNika Haghtalab, Michael I. Jordan, Eric ZhaoNeurIPS 2022 · 57 citations
- When is Multicalibration Post-Processing Necessary?Dutch Hansen, Siddartha Devic, Preetum Nakkiran, Vatsal SharanNeurIPS 2024 · 21 citations
- Truthfulness of Calibration MeasuresNika Haghtalab, Mingda Qiao, Kunhe Yang, Eric ZhaoNeurIPS 2024 · 10 citations
- Group-wise oracle-efficient algorithms for online multi-group learningSamuel Deng, Jingwen Liu, Daniel J. HsuNeurIPS 2024 · 8 citations
- Fairness-Aware Estimation of Graphical ModelsZhuoping Zhou, Davoud Ataee Tarzanagh, Bojian Hou, Qi Long et al.NeurIPS 2024 · 6 citations
Builds on6
- Distributionally Robust Neural NetworksShiori Sagawa, Pang Wei Koh, Tatsunori B. Hashimoto, Percy LiangICLR 2020 · 1,578 citations
- On-Demand Sampling: Learning Optimally from Multiple DistributionsNika Haghtalab, Michael I. Jordan, Eric ZhaoNeurIPS 2022 · 57 citations
- Multi-group Agnostic PAC LearnabilityGuy N. Rothblum, Gal YonaICML 2021 · 48 citations
- Sample Complexity of Uniform Convergence for MulticalibrationEliran Shabat, Lee Cohen, Yishay MansourNeurIPS 2020 · 32 citations
- Simple and near-optimal algorithms for hidden stratification and multi-group learningChristopher J. Tosh, Daniel HsuICML 2022 · 28 citations
Related papers
- Omnipredictors for Constrained OptimizationLunjia Hu, Inbal Rachel Livni Navon, Omer Reingold, Chutong YangICML 2023 · 17 citations
- Swap Agnostic Learning, or Characterizing Omniprediction via MulticalibrationParikshit Gopalan, Michael P. Kim, Omer ReingoldNeurIPS 2023 · 39 citations
- The Statistical Scope of MulticalibrationGeorgy Noarov, Aaron RothICML 2023 · 10 citations
- Bridging Multicalibration and Out-of-distribution Generalization Beyond Covariate ShiftJiayun Wu, Jiashuo Liu, Peng Cui, Steven WuNeurIPS 2024 · 14 citations
- Selective Omniprediction and Fair AbstentionSílvia Casacuberta, Varun KanadeNeurIPS 2025 · 3 citations
