Preference-Based Dynamic Ranking Structure Recognition
Nan Lu, Jian Shi, Xinyu Tian
摘要
Preference-based data often appear complex and noisy but may conceal underlying homogeneous structures. This paper introduces a novel framework of ranking structure recognition for preference-based data. We first develop an approach to identify dynamic ranking groups by incorporating temporal penalties into a spectral estimation for the celebrated Bradley-Terry model. To detect structural changes, we introduce an innovative objective function and present a practicable algorithm based on dynamic programming. Theoretically, we establish the consistency of ranking group recognition by exploiting properties of a random 'design matrix' induced by a reversible Markov chain. We also tailor a group inverse technique to quantify the uncertainty in item ability estimates. Additionally, we prove the consistency of structure change recognition, ensuring the robustness of the proposed framework. Experiments on both synthetic and real-world datasets demonstrate the practical utility and interpretability of our approach.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper5
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida 等NeurIPS 2022 · 被引用 24,707 次
- Iterative Preference Learning from Human Feedback: Bridging Theory and Practice for RLHF under KL-constraintWei Xiong, Hanze Dong, Chenlu Ye, Ziqi Wang 等ICML 2024 · 被引用 346 次
- Principled Reinforcement Learning with Human Feedback from Pairwise or K-wise ComparisonsBanghua Zhu, Michael I. Jordan, Jiantao JiaoICML 2023 · 被引用 273 次
- Hybrid Learning to Rank for Financial Event RankingFuli Feng, Moxin Li, Cheng Luo, Ritchie Ng 等SIGIR 2021 · 被引用 10 次
- Detecting Abrupt Changes in Sequential Pairwise Comparison DataWanshan Li, Alessandro Rinaldo, Daren WangNeurIPS 2022 · 被引用 2 次
相关 Paper
- Bradley-Terry Rankings for Recommender Systems Across Dataset TaxonomiesEkaterina Grishina, Stepan L. Kuznetsov, Askar Tsyganov, Ilya Ivanov 等KDD 2026
- Entrywise Error Bounds for Spectral Ranking with Semi-Random AdversariesDongmin Lee, Anuran Makur, Japneet SinghKDD 2026
- Rank Aggregation via Heterogeneous Thurstone Preference ModelsTao Jin, Pan Xu, Quanquan Gu, Farzad FarnoudAAAI 2020 · 被引用 19 次
- Generalized Results for the Existence and Consistency of the MLE in the Bradley-Terry-Luce ModelHeejong Bong, Alessandro RinaldoICML 2022 · 被引用 23 次
- A Judge-Aware Ranking Framework for Evaluating Large Language Models without Ground TruthMingyuan Xu, Xinzi Tan, Jiawei Wu, Doudou ZhouICML 2026
