ACL Findings2026
GroupRank: A Groupwise Paradigm for Effective and Efficient Passage Reranking with LLMs
Meixiu Long, Duolin Sun, Dan Yang, Yihan Jiao, Lei Liu, Jiahai Wang, Binbin Hu, Yue Shen, Jie Feng, Zhehao Tan, Junjie Wang, Lianzhen Zhong
Abstract
Large Language Models (LLMs) have emerged as powerful tools for passage reranking in information retrieval, leveraging their superior reasoning capabilities to address the limitations of conventional models on complex queries. However, current LLM-based reranking paradigms are fundamentally constrained by an efficiencyaccuracy trade-off: (1) pointwise methods are efficient but ignore inter-document comparison, yielding suboptimal accuracy; (2) listwise methods capture global context but suffer from context-window constraints and prohibitive inference latency. To address these issues, we propose GroupRank, a novel paradigm that balances flexibility and context awareness. To unlock the full potential of groupwise reranking, we propose an answer-free data synthesis pipeline that fuses local pointwise signals with global listwise rankings. These samples facilitate supervised fine-tuning and reinforcement learning, with the latter guided by a specialized group-ranking reward comprising ranking-utility and group-alignment. These complementary components synergistically optimize document ordering and score calibration to reflect intrinsic query-document relevance. Experimental results show GroupRank achieves a state-of-the-art 65.2 NDCG@10 on BRIGHT and surpasses baselines by 2.1 points on R2MED, while delivering a 6.4×
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on6
- XCodeEval: An Execution-based Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and RetrievalMohammad Abdullah Matin Khan, M. Saiful Bari, Xuan Do Long, Weishi Wang et al.ACL 2024 · 21 citations
- FIRST: Faster Improved Listwise Reranking with Single Token DecodingRevanth Gangi Reddy, JaeHyeok Doo, Yifei Xu, Md. Arafat Sultan et al.EMNLP 2024 · 14 citations
- Sliding Windows Are Not the End: Exploring Full Ranking with Long-Context Large Language ModelsWenhan Liu, Xinyu Ma, Yutao Zhu, Ziliang Zhao et al.ACL 2025 · 10 citations
- Retro*: Optimizing LLMs for Reasoning-Intensive Document RetrievalJunwei Lan, Jianlyu Chen, Zheng Liu, Chaofan Li et al.ICLR 2026 · 8 citations
- ERank: Fusing Supervised Fine-Tuning and Reinforcement Learning for Effective and Efficient Text RerankingYuzheng Cai, Yanzhao Zhang, Dingkun Long, Mingxin Li et al.AAAI 2026 · 6 citations
Related papers
- CoRanking: Collaborative Ranking with Small and Large Ranking AgentsWenhan Liu, Xinyu Ma, Yutao Zhu, Lixin Su et al.EMNLP Findings 2025
- Self-Calibrated Listwise Reranking with Large Language ModelsRuiyang Ren, Yuhao Wang, Kun Zhou, Wayne Xin Zhao et al.WWW 2025 · 12 citations
- ReasonRank: Empowering Passage Ranking with Strong Reasoning AbilityWenhan Liu, Xinyu Ma, Weiwei Sun, Yutao Zhu et al.ACL 2026 · 43 citations
- REARANK: Reasoning Re-ranking Agent via Reinforcement LearningLe Zhang, Bo Wang, Xipeng Qiu, Siva Reddy et al.EMNLP 2025 · 14 citations
- ProRank: Prompt Warmup via Reinforcement Learning for Small Language Models RerankingXianming Li, Aamir Shakir, Rui Huang, Julius Lipp et al.ACL Findings 2026 · 2 citations
