DDP-WM: Disentangled Dynamics Prediction for Efficient World Models
Shicheng Yin, Kaixuan Yin, Weixing Chen, Yang Liu, Guanbin Li, Liang Lin
摘要
World models are essential for autonomous robotic planning. However, the substantial computational overhead of existing dense Transformerbased models significantly hinders real-time deployment. To address this efficiency-performance bottleneck, we introduce DDP-WM, a novel world model centered on the principle of Disentangled Dynamics Prediction (DDP). We hypothesize that latent state evolution in observed scenes is heterogeneous and can be decomposed into sparse primary dynamics driven by physical interactions and secondary context-driven background updates. DDP-WM realizes this decomposition through an architecture that integrates efficient historical processing with dynamic localization to isolate primary dynamics. By employing a cross-attention mechanism for background updates, the framework optimizes resource allocation and provides a smooth optimization landscape for planners. Extensive experiments demonstrate that DDP-WM achieves significant efficiency and performance across diverse tasks, including navigation, precise tabletop manipulation, and complex deformable or multi-body interactions. Specifically, on the challenging Push-T task, DDP-WM achieves an approximately 9× inference speedup and improves the MPC success rate from 90% to 98% compared to state-of-theart dense models. The results establish a promising path for developing efficient, high-fidelity world models. Codes is available at https: //hcplab-sysu.github.io/DDP-WM/ .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper13
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn 等ICLR 2021 · 被引用 21,477 次
- Dream to Control: Learning Behaviors by Latent ImaginationDanijar Hafner, Timothy P. Lillicrap, Jimmy Ba, Mohammad NorouziICLR 2020 · 被引用 1,852 次
- Object-Centric Learning with Slot AttentionFrancesco Locatello, Dirk Weissenborn, Thomas Unterthiner, Aravindh Mahendran 等NeurIPS 2020 · 被引用 1,275 次
- Mastering Atari with Discrete World ModelsDanijar Hafner, Timothy P. Lillicrap, Mohammad Norouzi, Jimmy BaICLR 2021 · 被引用 1,170 次
- Model Based Reinforcement Learning for AtariLukasz Kaiser, Mohammad Babaeizadeh, Piotr Milos, Blazej Osinski 等ICLR 2020 · 被引用 969 次
相关 Paper
- Learning Disentangled Multi-Agent World Model for Decentralized ControlDi Xue, Jing Jiang, Shaowei Zhang, Wenhao Guo 等ICML 2026 · 被引用 2 次
- RoboFlow4D: A Lightweight Flow World Model Toward Real-Time Flow-Guided Robotic ManipulationSixu Lin, Junliang Chen, Huaiyuan Xu, Zhuohao Li 等ICML 2026 · 被引用 3 次
- Pre-training Contextualized World Models with In-the-wild Videos for Reinforcement LearningJialong Wu, Haoyu Ma, Chaoyi Deng, Mingsheng LongNeurIPS 2023 · 被引用 55 次
- Planning in 8 Tokens: A Compact Discrete Tokenizer for Latent World ModelDongwon Kim, Gawon Seo, Jinsung Lee, Minsu Cho 等CVPR 2026 · 被引用 6 次
- From Forecasting to Planning: Policy World Model for Collaborative State-Action PredictionZhida Zhao, Talas Fu, Yifan Wang, Lijun Wang 等NeurIPS 2025 · 被引用 36 次
