Lune

EMNLP Findings2020

Making Information Seeking Easier: An Improved Pipeline for Conversational Search

Vaibhav Kumar, Jamie Callan

Abstract

This paper presents a highly effective pipeline for passage retrieval in a conversational search setting. The pipeline comprises of two components: Conversational Term Selection (CTS) and Multi-View Reranking (MVR). CTS is responsible for performing the first-stage of passage retrieval. Given an input question, it uses a BERT-based classifier (trained with weak supervision) to de-contextualize the input by selecting relevant terms from the dialog history. Using the question and the selected terms, it issues a query to a search engine to perform the first-stage of passage retrieval. On the other hand, MVR is responsible for contextualized passage reranking. It first constructs multiple views of the information need embedded within an input question. The views are based on the dialog history and the top documents obtained in the first-stage of retrieval. It then uses each view to rerank passages using BERT (fine-tuned for passage ranking). Finally, MVR performs a fusion over the rankings produced by the individual views. Experiments show that the above combination improves first-state retrieval as well as the overall accuracy in a reranking pipeline. On the key metric of NDCG@3, the proposed combination achieves a relative performance improvement of 14.8% over the state-of-the-art baseline and is also able to surpass the Oracle.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

9 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement Learning cites Contextualized Query Embeddings for Conversational Search
  • CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement Learning cites Few-Shot Conversational Dense Retrieval
  • ConvGQR: Generative Query Reformulation for Conversational Search cites CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement Learning
  • ConvGQR: Generative Query Reformulation for Conversational Search cites Few-Shot Conversational Dense Retrieval
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers9

  1. Few-Shot Conversational Dense RetrievalShi Yu, Zhenghao Liu, Chenyan Xiong, Tao Feng et al.SIGIR 2021 · 75 citations
  2. ISEEQ: Information Seeking Question Generation Using Dynamic Meta-Information Retrieval and Knowledge GraphsManas Gaur, Kalpa Gunaratna, Vijay Srinivasan, Hongxia JinAAAI 2022 · 60 citations
  3. Contextualized Query Embeddings for Conversational SearchSheng-Chieh Lin, Jheng-Hong Yang, Jimmy LinEMNLP 2021 · 40 citations
  4. CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement LearningZeqiu Wu, Yi Luan, Hannah Rashkin, David Reitter et al.EMNLP 2022 · 37 citations
  5. ConvGQR: Generative Query Reformulation for Conversational SearchFengran Mo, Kelong Mao, Yutao Zhu, Yihong Wu et al.ACL 2023 · 29 citations

Related papers

  1. Query Resolution for Conversational Search with Limited SupervisionNikos Voskarides, Dan Li, Pengjie Ren, Evangelos Kanoulas et al.SIGIR 2020 · 112 citations
  2. Improving Passage Retrieval with Zero-Shot Question GenerationDevendra Singh Sachan, Mike Lewis, Mandar Joshi, Armen Aghajanyan et al.EMNLP 2022 · 69 citations
  3. Learning When to Retrieve, What to Rewrite, and How to Respond in Conversational QANirmal Roy, Leonardo F. R. Ribeiro, Rexhina Blloshmi, Kevin SmallEMNLP Findings 2024 · 6 citations
  4. Shifting from Ranking to Set Selection for Retrieval Augmented GenerationDahyun Lee, Yongrae Jo, Haeju Park, Moontae LeeACL 2025
  5. Open-Retrieval Conversational Question AnsweringChen Qu, Liu Yang, Cen Chen, Minghui Qiu et al.SIGIR 2020 · 84 citations
Dusk over the sea between two cliffs drawn in fine vertical lines