Knowledge-Driven Virtual Network Embedding with Dynamic World Model
Yangzi Song, Baoquan Ren, Yulong Shen, Qijie Qian, Jiaqi Lin
摘要
Virtual Network Embedding (VNE) is a fundamental yet challenging task in network virtualization, particularly in dynamic and uncertain environments. While deep reinforcement learning (DRL) has shown promise, its reliance on implicit knowledge modeling—entangling historical experience within neural network parameters—constrains adaptability and interpretability, hindering deployment in production networks. To address this, we introduce Knowledge-Driven VNE (KD-VNE), a framework built on the principle of decoupling knowledge representation from the policy network. At its core, KD-VNE leverages a Temporal Knowledge Graph (TKG) as an explicit world model, empowering the agent with structured reasoning over network dynamics. This externalized knowledge is integrated within a hybrid Actor-Critic agent that synthesizes real-time state, TKG-curated experience, and domain heuristics through a dual-loop mechanism, enabling both rapid tactical adaptation and long-term strategic optimization. Extensive experiments show that KD-VNE achieves competitive acceptance ratios and improved economic efficiency. More critically, it demonstrates exceptional cross-domain generalization, achieving the highest acceptance ratio on real-world network topologies—outperforming the DRL baseline by over 80%—all without retraining.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- GAL-VNE: Solving the VNE Problem with Global Reinforcement Learning and Local One-Shot Neural PredictionHaoyu Geng, Runzhong Wang, Fei Wu, Junchi YanKDD 2023 · 被引用 5 次
- CADRL: Category-Aware Dual-Agent Reinforcement Learning for Explainable Recommendations over Knowledge GraphsShangfei Zheng, Hongzhi Yin, Tong Chen, Xiangjie Kong 等ICDE 2025 · 被引用 3 次
- ViterbiPlanNet: Injecting Procedural Knowledge via Differentiable Viterbi for Planning in Instructional VideosLuigi Seminara, Davide Moltisanti, Antonino FurnariCVPR 2026 · 被引用 4 次
- Flexible Attention-Based Multi-Policy Fusion for Efficient Deep Reinforcement LearningZih-Yun Chiu, Yi-Lin Tuan, William Yang Wang, Michael C. YipNeurIPS 2023 · 被引用 7 次
- TempoQR: Temporal Question Reasoning over Knowledge GraphsCostas Mavromatis, Prasanna Lakkur Subramanyam, Vassilis N. Ioannidis, Adesoji Adeshina 等AAAI 2022 · 被引用 77 次
