EMNLP Findings2024
ConTReGen: Context-driven Tree-structured Retrieval for Open-domain Long-form Text Generation
Kashob Kumar Roy, Pritom Saha Akash, Kevin Chen-Chuan Chang, Lucian Popa
Abstract
Open-domain long-form text generation requires generating coherent, comprehensive responses that address complex queries with both breadth and depth. This task is challenging due to the need to accurately capture diverse facets of input queries. Existing iterative retrievalaugmented generation (RAG) approaches often struggle to delve deeply into each facet of complex queries and integrate knowledge from various sources effectively. This paper introduces ConTReGen, a novel framework that employs a context-driven, tree-structured retrieval approach to enhance the depth and relevance of retrieved content. ConTReGen integrates a hierarchical, top-down in-depth exploration of query facets with a systematic bottom-up synthesis, ensuring comprehensive coverage and coherent integration of multifaceted information. Extensive experiments on multiple datasets, including LFQA and ODSUM, alongside a newly introduced dataset, ODSUM-WikiHow, demonstrate that ConTReGen outperforms existing state-of-the-art RAG models. 1
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
3 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval cites Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
- PruneRAG: Confidence-Guided Query Decomposition Trees for Efficient Retrieval-Augmented Generation cites Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection
- PruneRAG: Confidence-Guided Query Decomposition Trees for Efficient Retrieval-Augmented Generation cites Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
- Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection cites Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
- Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection cites Active Retrieval Augmented Generation
- Making Retrieval-Augmented Language Models Robust to Irrelevant Context cites Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
- Making Retrieval-Augmented Language Models Robust to Irrelevant Context cites Active Retrieval Augmented Generation
- Disco-RAG: Discourse-Aware Retrieval-Augmented Generation cites RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval
- Disco-RAG: Discourse-Aware Retrieval-Augmented Generation cites Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection
- Disco-RAG: Discourse-Aware Retrieval-Augmented Generation cites Active Retrieval Augmented Generation
- Active Retrieval Augmented Generation cites Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Cited by top-tier papers3
- PruneRAG: Confidence-Guided Query Decomposition Trees for Efficient Retrieval-Augmented GenerationShuguang Jiao, Xinyu Xiao, Yunfan Wei, Shuhan Qi et al.WWW 2026 · 2 citations
- Disco-RAG: Discourse-Aware Retrieval-Augmented GenerationDongqi Liu, Hang Ding, Qiming Feng, Xurong Xie et al.ACL 2026
- WikiMAG: A Multi-Agent Guided Framework for Generating Structured Wikipedia-like ArticlesXiuli Kang, Yinlong Xiao, Minghao Hu, Yuan Huang et al.AAAI 2026
Builds on17
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- Self-RAG: Learning to Retrieve, Generate, and Critique through Self-ReflectionAkari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil et al.ICLR 2024 · 1,798 citations
- RAPTOR: Recursive Abstractive Processing for Tree-Organized RetrievalParth Sarthi, Salman Abdullah, Aditi Tuli, Shubh Khanna et al.ICLR 2024 · 460 citations
- Making Retrieval-Augmented Language Models Robust to Irrelevant ContextOri Yoran, Tomer Wolfson, Ori Ram, Jonathan BerantICLR 2024 · 361 citations
- Active Retrieval Augmented GenerationZhengbao Jiang, Frank F. Xu, Luyu Gao, Zhiqing Sun et al.EMNLP 2023 · 315 citations
Related papers
- LightRAG: Simple and Fast Retrieval-Augmented GenerationZirui Guo, Lianghao Xia, Yanhua Yu, Tu Ao et al.EMNLP Findings 2025 · 209 citations
- Iterative Multi-Granular RAG with Contextual Hierarchical GraphYanli Hu, Teng Liu, Zhuangyi Zhou, Weixin Zeng et al.AAAI 2026
- EventRAG: Enhancing LLM Generation with Event Knowledge GraphsZairun Yang, Yilin Wang, Zhengyan Shi, Yuan Yao et al.ACL 2025 · 6 citations
- CoRAG: Enhancing Hybrid Retrieval-Augmented Generation through a Cooperative Retriever ArchitectureZaiyi Zheng, Song Wang, Zihan Chen, Yaochen Zhu et al.EMNLP Findings 2025 · 1 citation
- BookRAG: A Hierarchical Structure-aware Index-based Approach for Retrieval-Augmented Generation on Complex DocumentsShu Wang, Yingli Zhou, Yixiang FangVLDB 2026 · 16 citations
