Diversifying Differentiable Graph Retrieval with Topic-Adaptive Multi-Intent Learning
Dongcheon Lee, Ji-Yeon Park, Hye-Yoon Baek, Jimyeung Seo, Seyeong Kim, Byungkook Oh
Abstract
Knowledge Graph Question Answering (KGQA) leverages struc- tured knowledge graphs for reliable reasoning. Graph-based Retrieval- Augmented Generation (RAG) addresses the incompleteness and hallucination issues of Large Language Models (LLMs) by retrieving query-relevant subgraphs. However, existing approaches rely on single-intent semantic retrieval, compressing queries into single representations and optimizing each query independently. This leads to narrow triple selection that omits complementary information. While multi-intent retrieval diversification addresses this limitation, it faces critical challenges: (1) semantic diversification does not guarantee reasoning performance, and (2) co-selection frequency across intents does not ensure reasoning benefit. We propose Topic-Adaptive Retrieval Diversification (TARD), based on end-to-end optimization via generation feedback. TARD adaptively extracts multiple topic-based intents through neural topic modeling and employs a Gumbel-Softmax differentiable sampling to enable joint optimization. Supervised fine-tuning aligns the topic-adaptive multi-intent selector and triple scorer with reasoning performance to achieve beneficial consensus patterns. Adaptive direct preference optimization trains the generator to utilize relevant consensus while ignoring uninformative patterns. Experiments on WebQSP and CWQ show that TARD outperforms state-of-the-art baselines. Our code and data are publicly available at https://github.com/leedongcheon/TARD.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Related papers
- D-RAG: Differentiable Retrieval-Augmented Generation for Knowledge Graph Question AnsweringGuangze Gao, Zixuan Li, Chunfeng Yuan, Jiawei Li et al.EMNLP 2025
- TAdaRAG: Task Adaptive Retrieval-Augmented Generation via On-the-Fly Knowledge Graph ConstructionJie Zhang, Bo Tang, Wanzi Shao, Wenqiang Wei et al.AAAI 2026
- Simple is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented GenerationMufei Li, Siqi Miao, Pan LiICLR 2025
- Plan Then Retrieve: Reinforcement Learning-Guided Complex Reasoning over Knowledge GraphsYanlin Song, Ben Liu, Víctor Gutiérrez-Basulto, Zhiwei Hu et al.WWW 2026
- Empowering GraphRAG with Knowledge Filtering and IntegrationKai Guo, Harry Shomer, Shenglai Zeng, Haoyu Han et al.EMNLP 2025 · 2 citations
