Lune

EMNLP Findings2024

Numbers Matter! Bringing Quantity-awareness to Retrieval Systems

Satya Almasian, Milena Bruseva, Michael Gertz

Abstract

Quantitative information plays a crucial role in understanding and interpreting the content of documents. Many user queries contain quantities and cannot be resolved without understanding their semantics, e.g., "car that costs less than $10k". Yet, modern search engines apply the same ranking mechanisms for both words and quantities, overlooking magnitude and unit information. In this paper, we introduce two quantity-aware ranking techniques designed to rank both the quantity and textual content either jointly or independently. These techniques incorporate quantity information in available retrieval systems and can address queries with numerical conditions equal, greater than, and less than. To evaluate the effectiveness of our proposed models, we introduce two novel quantity-aware benchmark datasets in the domains of finance and medicine and compare our method against various lexical and neural models. The code and the benchmark datasets are available under https://github. com/satya77/QuantityAwareRankers.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 1 top-tier paper that cites it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers1

  1. NumColBERT: Non-Intrusive Numeracy Injection for Late-Interaction Retrieval ModelsHaruki Fujimaki, Makoto P. KatoSIGIR 2026

Builds on5

  1. ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTOmar Khattab, Matei ZahariaSIGIR 2020 · 1,246 citations
  2. Methods for Numeracy-Preserving Word EmbeddingsDhanasekar Sundararaman, Shijing Si, Vivek Subramanian, Guoyin Wang et al.EMNLP 2020 · 28 citations
  3. Learning Numeral EmbeddingChengyue Jiang, Zhonglin Nian, Kaihao Guo, Shanbo Chu et al.EMNLP Findings 2020 · 25 citations
  4. Injecting Numerical Reasoning Skills into Language ModelsMor Geva, Ankit Gupta, Jonathan BerantACL 2020 · 12 citations
  5. CQE: A Comprehensive Quantity ExtractorSatya Almasian, Vivian Kazakova, Philip Göldner, Michael GertzEMNLP 2023 · 3 citations

Related papers

  1. Dense Retrieval with Quantity Comparison IntentPrayas Agrawal, Nandeesh Kumar, Muthusamy Chelliah, Surender Kumar et al.ACL Findings 2025 · 1 citation
  2. Extracting Contextualized Quantity Facts from Web TablesVinh Thinh Ho, Koninika Pal, Simon Razniewski, Klaus Berberich et al.WWW 2021 · 13 citations
  3. RARE: Redundancy-Aware Retrieval Evaluation Framework for High-Similarity CorporaHanjun Cho, Jay-Yoon LeeACL 2026 · 1 citation
  4. Enhancing Quantitative Reasoning Skills of Large Language Models through Dimension PerceptionYuncheng Huang, Qianyu He, Jiaqing Liang, Sihang Jiang et al.ICDE 2024 · 3 citations
  5. BizBench: A Quantitative Reasoning Benchmark for Business and FinanceMichael Krumdick, Rik Koncel-Kedziorski, Viet Dac Lai, Varshini Reddy et al.ACL 2024 · 10 citations
Dusk over the sea between two cliffs drawn in fine vertical lines