DLLM-Searcher: Adapting Diffusion Language Model for Efficient Search Agents
Jiahao Zhao, Shaoxuan Xu, Zhongxiang Sun, Fengqi Zhu, Jingyang Ou, Yuling Shi, Chongxuan Li, Xiao Zhang, Jun Xu
Abstract
Recently, Diffusion Large Language Models (dLLMs) have demonstrated unique efficiency advantages, enabled by their inherently parallel decoding mechanism and flexible generation paradigm. Meanwhile, despite the rapid advancement of Search Agents, their practical deployment is constrained by a fundamental limitation, termed as 1) Latency Challenge : the serial execution of multi-round reasoning, tool calling, and tool response waiting under the ReAct agent paradigm induces severe end-to-end latency. Intuitively, dLLMs can leverage their distinctive strengths to optimize the operational efficiency of agents under the ReAct agent paradigm. Practically, existing dLLM backbones face the 2) Agent Ability Challenge. That is, existing dLLMs exhibit remarkably weak reasoning and tool-calling capabilities, preventing these advantages from being effectively realized in practice. In this paper, we propose DLLM-Searcher, an optimization framework for dLLM-based Search Agents. To solve the Agent Ability Challenge, we design a two-stage post-training pipeline encompassing Agentic Supervised Fine-Tuning (Agentic SFT) and Agentic Variance-Reduced Preference Optimization (Agentic VRPO), which enhances the backbone dLLM's information seeking and reasoning capabilities. To mitigate the Latency Challenge, we leverage the flexible generation mechanism of dLLMs and propose a novel agent paradigm termed Parallel-Reasoning and Acting (P-ReAct). P-ReAct guides the model to prioritize decoding tool_call instructions, thereby allowing the model to keep thinking while waiting for the tool's return. Experimental results demonstrate that DLLM-Searcher achieves performance comparable to mainstream LLM-based search agents and P-ReAct delivers approximately 15% inference acceleration. Our code is available at https://github.com/bubble65/DLLM-Searcher
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 12acbf0f-d31e-41cc-9ea8-400b3dc2972eRelated papers
- The Bitter Lesson of Diffusion Language Models for Agentic Workflows: A Comprehensive Reality CheckQingyu Lu, Liang Ding, Kanjian Zhang, Jinxia Zhang et al.ACL 2026 · 1 citation
- Demystifying and Enhancing the Efficiency of Large Language Model Based Search AgentsTiannuo Yang, Zebin Yao, Bowen Jin, Lixiao Cui et al.ICLR 2026 · 9 citations
- Flash-Searcher: Fast and Effective Web Agents via DAG-Based Parallel ExecutionTianrui Qin, Qianben Chen, Sinuo Wang, He Xing et al.ICLR 2026 · 28 citations
- Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic ToolsJunde Wu, Jiayuan Zhu, Yuyuan Liu, Min Xu et al.ACL 2025 · 88 citations
- Beyond ReAct: A Planner-Centric Framework for Complex Tool-Augmented LLM ReasoningXiaolong Wei, Yuehu Dong, Xingliang Wang, Xingyu Zhang et al.AAAI 2026 · 10 citations
