Generalized Bradley-Terry Models for Score Estimation from Paired Comparisons
Julien Fageot, Sadegh Farhadkhani, Lê-Nguyên Hoang, Oscar Villemaud
Abstract
Many applications, e.g. in content recommendation, sports, or recruitment, leverage the comparisons of alternatives to score those alternatives. The classical Bradley-Terry model and its variants have been widely used to do so. The historical model considers binary comparisons (victory/defeat) between alternatives, while more recent developments allow finer comparisons to be taken into account. In this article, we introduce a probabilistic model encompassing a broad variety of paired comparisons that can take discrete or continuous values. We do so by considering a well-behaved subset of the exponential family, which we call the family of generalized Bradley-Terry (GBT) models, as it includes the classical Bradley-Terry model and many of its variants. Remarkably, we prove that all GBT models are guaranteed to yield a strictly convex negative log-likelihood. Moreover, assuming a Gaussian prior on alternatives' scores, we prove that the maximum a posteriori (MAP) of GBT models, whose existence, uniqueness and fast computation are thus guaranteed, varies monotonically with respect to comparisons (the more A beats B, the better the score of A) and is Lipschitz-resilient with respect to each new comparison (a single new comparison can only have a bounded effect on all the estimated scores). These desirable properties make GBT models appealing for practical use. We illustrate some features of GBT models on simulations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext dae01db6-5978-40a1-93ce-cdb888508114Cited by top-tier papers3
- WizardArena: Post-training Large Language Models via Simulated Offline Chatbot ArenaHaipeng Luo, Qingfeng Sun, Can Xu, Pu Zhao et al.NeurIPS 2024 · 7 citations
- Generalizing while preserving monotonicity in comparison-based preference learning modelsJulien Fageot, Peva Blanchard, Gilles Bareilles, Lê-Nguyên HoangNeurIPS 2025 · 2 citations
- UniCBE: An Uniformity-driven Comparing Based Evaluation Framework with Unified Multi-Objective OptimizationPeiwen Yuan, Shaoxiong Feng, Yiwei Li, Xinglin Wang et al.ICLR 2025
Related papers
- Generalized Results for the Existence and Consistency of the MLE in the Bradley-Terry-Luce ModelHeejong Bong, Alessandro RinaldoICML 2022 · 23 citations
- Rethinking Reward Modeling in Preference-based Large Language Model AlignmentHao Sun, Yunyi Shen, Jean-Francois TonICLR 2025
- Robust AI Evaluation through Maximal LotteriesHadi Khalaf, Serena Wang, Daniel Halpern, Itai Shapira et al.ICML 2026 · 2 citations
- Efficient Bayesian Inference from Noisy Pairwise ComparisonsTill Aczel, Lucas Theis, Roger WattenhoferICML 2026 · 2 citations
- What Does Preference Learning Recover from Pairwise Comparison Data?Rattana Pukdee, Nina Balcan, Pradeep RavikumarICML 2026 · 1 citation
