Preference-Based Dynamic Ranking Structure Recognition
Nan Lu, Jian Shi, Xinyu Tian
Abstract
Preference-based data often appear complex and noisy but may conceal underlying homogeneous structures. This paper introduces a novel framework of ranking structure recognition for preference-based data. We first develop an approach to identify dynamic ranking groups by incorporating temporal penalties into a spectral estimation for the celebrated Bradley-Terry model. To detect structural changes, we introduce an innovative objective function and present a practicable algorithm based on dynamic programming. Theoretically, we establish the consistency of ranking group recognition by exploiting properties of a random 'design matrix' induced by a reversible Markov chain. We also tailor a group inverse technique to quantify the uncertainty in item ability estimates. Additionally, we prove the consistency of structure change recognition, ensuring the robustness of the proposed framework. Experiments on both synthetic and real-world datasets demonstrate the practical utility and interpretability of our approach.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on5
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- Iterative Preference Learning from Human Feedback: Bridging Theory and Practice for RLHF under KL-constraintWei Xiong, Hanze Dong, Chenlu Ye, Ziqi Wang et al.ICML 2024 · 346 citations
- Principled Reinforcement Learning with Human Feedback from Pairwise or K-wise ComparisonsBanghua Zhu, Michael I. Jordan, Jiantao JiaoICML 2023 · 273 citations
- Hybrid Learning to Rank for Financial Event RankingFuli Feng, Moxin Li, Cheng Luo, Ritchie Ng et al.SIGIR 2021 · 10 citations
- Detecting Abrupt Changes in Sequential Pairwise Comparison DataWanshan Li, Alessandro Rinaldo, Daren WangNeurIPS 2022 · 2 citations
Related papers
- Bradley-Terry Rankings for Recommender Systems Across Dataset TaxonomiesEkaterina Grishina, Stepan L. Kuznetsov, Askar Tsyganov, Ilya Ivanov et al.KDD 2026
- Entrywise Error Bounds for Spectral Ranking with Semi-Random AdversariesDongmin Lee, Anuran Makur, Japneet SinghKDD 2026
- Rank Aggregation via Heterogeneous Thurstone Preference ModelsTao Jin, Pan Xu, Quanquan Gu, Farzad FarnoudAAAI 2020 · 19 citations
- Generalized Results for the Existence and Consistency of the MLE in the Bradley-Terry-Luce ModelHeejong Bong, Alessandro RinaldoICML 2022 · 23 citations
- A Judge-Aware Ranking Framework for Evaluating Large Language Models without Ground TruthMingyuan Xu, Xinzi Tan, Jiawei Wu, Doudou ZhouICML 2026
