Lune

EMNLP Findings2023

Search Augmented Instruction Learning

Hongyin Luo, Tianhua Zhang, Yung-Sung Chuang, Yuan Gong, Yoon Kim, Xixin Wu, Helen Meng, James R. Glass

Abstract

It is widely believed that connecting large language models with search engines can improve their transparency, truthfulness, and accessing to up-to-date information. However, we show that search grounding introduces new challenges to language models because of distracting, misleading, and untrustworthy information. To deal with these difficulties, we propose search-augmented instruction learning (SAIL), which allows a fine-tuned language model to source, denoise, and reason based on a mixed set of helpful and distracting search results. With an instruction tuning corpus, we collect search results for each training case from different search APIs and domains, and construct a new search-grounded training set containing (instruction, grounding information, response) triplets. We then fine-tune the LLaMA-7B model on the constructed training set. Since the collected search results contain distracting and disputing languages, the model needs to learn to ground on trustworthy search results, filter out distracting passages, and generate the target response. The search result-denoising process entails explicit trustworthy information selection and multi-hop reasoning, since the retrieved passages might be informative but not contain the instruction-following answer. Experiments show that the fine-tuned SAIL-7B model has a strong instruction-following ability, and it performs significantly better on transparencysensitive tasks, including question answering and fact checking.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

4 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • MMSearch-R1: Incentivizing LMMs to Search cites Toolformer: Language Models Can Teach Themselves to Use Tools
  • MMSearch-R1: Incentivizing LMMs to Search cites RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMs
  • MMSearch-R1: Incentivizing LMMs to Search cites Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
  • PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models cites Language Models are Few-Shot Learners
  • PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models cites Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
  • Language Models are Few-Shot Learners cites Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
  • Shanks: Simultaneous Hearing and Thinking for Spoken Language Models cites Toolformer: Language Models Can Teach Themselves to Use Tools
  • Shanks: Simultaneous Hearing and Thinking for Spoken Language Models cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • Chain-of-Thought Prompting Elicits Reasoning in Large Language Models cites Training language models to follow instructions with human feedback
  • Training language models to follow instructions with human feedback cites Language Models are Few-Shot Learners
  • RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMs cites Training language models to follow instructions with human feedback
  • RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMs cites Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers4

  1. RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMsYue Yu, Wei Ping, Zihan Liu, Boxin Wang et al.NeurIPS 2024 · 321 citations
  2. MMSearch-R1: Incentivizing LMMs to SearchJinming Wu, Zihao Deng, Wei Li, Yiding Liu et al.ACL 2026 · 93 citations
  3. Shanks: Simultaneous Hearing and Thinking for Spoken Language ModelsCheng-Han Chiang, Xiaofei Wang, Linjie Li, Chung-Ching Lin et al.ACL 2026 · 14 citations
  4. PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language ModelsWei Zou, Runpeng Geng, Binghui Wang, Jinyuan JiaUSENIX Security 2025

Builds on16

  1. Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
  2. Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
  3. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
  4. Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
  5. Toolformer: Language Models Can Teach Themselves to Use ToolsTimo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu et al.NeurIPS 2023 · 5,989 citations

Related papers

  1. Fine-Tuning Language Models for FactualityKatherine Tian, Eric Mitchell, Huaxiu Yao, Christopher D. Manning et al.ICLR 2024 · 270 citations
  2. Search Arena: Analyzing Search-Augmented LLMsMihran Miroyan, Tsung-Han Wu, Logan King, Tianle Li et al.ICLR 2026 · 32 citations
  3. Beneficial Reasoning Behaviors in Agentic Search and Effective Training Methods to Obtain ThemJiahe Jin, Abhijay Sai Paladugu, Chenyan XiongACL Findings 2026
  4. Exploring the Impact of Instruction-Tuning on LLM's Susceptibility to MisinformationKyubeen Han, Junseo Jang, Hongjin Kim, Geunyeong Jeong et al.ACL 2025
  5. Trustworthy Medical Question Answering: An Evaluation-Centric SurveyYinuo Wang, Baiyang Wang, Robert E. Mercer, Frank Rudzicz et al.EMNLP 2025 · 2 citations
Dusk over the sea between two cliffs drawn in fine vertical lines