Learning to Rank by Directly Optimizing Full-Order Probabilities
Yongxiang Tang, Chao Wang, Jincheng Lu, Yanhua Cheng, Xialong Liu, Peng Jiang
Abstract
Learning to rank can be cast as a probabilistic modeling problem over permutations, where the goal is to estimate the likelihood of an observed total ordering of items. This formulation naturally involves full-order probabilities of the form , whose exact computation and optimization are intractable due to the factorial growth of the permutation space with respect to the list size. In this work, we introduce the Full-Order Bound (FOB), a tractable lower bound on the probability of an observed ordering, constructed from a subset of ordering constraints that factorizes across items while preserving full-order structure and order-reversal invariance. Under log-concave latent densities, the bound induces a convex inner tightening problem over latent cut points, which we solve efficiently during training using a safe-region gradient ascent (SRGA) procedure. Experiments on synthetic ranking tasks and large-scale learning-to-rank benchmarks show that FOB improves full-list ordering metrics and remains competitive on NDCG, while an optional metric-aligned variant recovers NDCG gains. Our code is available at https://github.com/tyxaaron/FOB.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3c9e12c8-e23f-47fb-9f87-2464cd1a0a21Builds on3
- PiRank: Scalable Learning To Rank via Differentiable SortingRobin M. E. Swezey, Aditya Grover, Bruno Charron, Stefano ErmonNeurIPS 2021 · 45 citations
- Monotonic Differentiable Sorting NetworksFelix Petersen, Christian Borgelt, Hilde Kuehne, Oliver DeussenICLR 2022 · 32 citations
- Generalized Neural Sorting Networks with Error-Free Differentiable Swap FunctionsJungtaek Kim, Jeongbeen Yoon, Minsu ChoICLR 2024 · 5 citations
Related papers
- An Alternative Cross Entropy Loss for Learning-to-RankSebastian BruchWWW 2021 · 58 citations
- StochasticRank: Global Optimization of Scale-Free Discrete FunctionsAleksei Ustimenko, Liudmila ProkhorenkovaICML 2020 · 21 citations
- OPS: An Order-Preserving Sorting Network for Information RetrievalChao Wang, Yongxiang Tang, Guikai Luan, Kaiyuan Li et al.SIGIR 2026
- Adaptive Neural Ranking Framework: Toward Maximized Business Goal for Cascade Ranking SystemsYunli Wang, Zhiqiang Wang, Jian Yang, Shiyang Wen et al.WWW 2024 · 16 citations
- Parametric Graph for Unimodal Ranking BanditCamille-Sovanneary Gauthier, Romaric Gaudel, Élisa Fromont, Boammani Aser LompoICML 2021 · 5 citations
