Knowledge-Driven Virtual Network Embedding with Dynamic World Model
Yangzi Song, Baoquan Ren, Yulong Shen, Qijie Qian, Jiaqi Lin
Abstract
Virtual Network Embedding (VNE) is a fundamental yet challenging task in network virtualization, particularly in dynamic and uncertain environments. While deep reinforcement learning (DRL) has shown promise, its reliance on implicit knowledge modeling—entangling historical experience within neural network parameters—constrains adaptability and interpretability, hindering deployment in production networks. To address this, we introduce Knowledge-Driven VNE (KD-VNE), a framework built on the principle of decoupling knowledge representation from the policy network. At its core, KD-VNE leverages a Temporal Knowledge Graph (TKG) as an explicit world model, empowering the agent with structured reasoning over network dynamics. This externalized knowledge is integrated within a hybrid Actor-Critic agent that synthesizes real-time state, TKG-curated experience, and domain heuristics through a dual-loop mechanism, enabling both rapid tactical adaptation and long-term strategic optimization. Extensive experiments show that KD-VNE achieves competitive acceptance ratios and improved economic efficiency. More critically, it demonstrates exceptional cross-domain generalization, achieving the highest acceptance ratio on real-world network topologies—outperforming the DRL baseline by over 80%—all without retraining.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 8d13e8a3-34b9-46a1-8df9-e9336998a6a4Related papers
- GAL-VNE: Solving the VNE Problem with Global Reinforcement Learning and Local One-Shot Neural PredictionHaoyu Geng, Runzhong Wang, Fei Wu, Junchi YanKDD 2023 · 5 citations
- CADRL: Category-Aware Dual-Agent Reinforcement Learning for Explainable Recommendations over Knowledge GraphsShangfei Zheng, Hongzhi Yin, Tong Chen, Xiangjie Kong et al.ICDE 2025 · 3 citations
- ViterbiPlanNet: Injecting Procedural Knowledge via Differentiable Viterbi for Planning in Instructional VideosLuigi Seminara, Davide Moltisanti, Antonino FurnariCVPR 2026 · 4 citations
- Flexible Attention-Based Multi-Policy Fusion for Efficient Deep Reinforcement LearningZih-Yun Chiu, Yi-Lin Tuan, William Yang Wang, Michael C. YipNeurIPS 2023 · 7 citations
- TempoQR: Temporal Question Reasoning over Knowledge GraphsCostas Mavromatis, Prasanna Lakkur Subramanyam, Vassilis N. Ioannidis, Adesoji Adeshina et al.AAAI 2022 · 77 citations
