PerpetualWonder: Long-horizon Action-conditioned 4D Scene Generation
Jiahao Zhan, Zizhang Li, Hong-Xing Yu, Jiajun Wu
摘要
We introduce PerpetualWonder, a hybrid generative simulator that enables long-horizon, action-conditioned 4D scene generation from a single image. Current works fail at this task because their physical state is decoupled from their visual representation, which prevents generative refinements to update the underlying physics for subsequent interactions. PerpetualWonder solves this by introducing the first true closed-loop system. It features a novel unified representation that creates a bidirectional link between the physical state and visual primitives, allowing generative refinements to correct both the dynamics and appearance. It also introduces a robust update mechanism that gathers supervision from multiple viewpoints to resolve optimization ambiguity. Experiments demonstrate that from a single image, PerpetualWonder can successfully simulate complex, multi-step interactions from long-horizon actions, maintaining physical plausibility and visual consistency.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper31
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- Nerfies: Deformable Neural Radiance FieldsKeunhong Park, Utkarsh Sinha, Jonathan T. Barron, Sofien Bouaziz 等ICCV 2021 · 被引用 1,442 次
- Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian SplattingZeyu Yang, Hongye Yang, Zijie Pan, Li ZhangICLR 2024 · 被引用 529 次
- 4D Gaussian Splatting for Real-Time Dynamic Scene RenderingGuanjun Wu, Taoran Yi, Jiemin Fang, Lingxi Xie 等CVPR 2024 · 被引用 513 次
- Text-To-4D Dynamic Scene GenerationUriel Singer, Shelly Sheynin, Adam Polyak, Oron Ashual 等ICML 2023 · 被引用 234 次
相关 Paper
- Wonderplay: Dynamic 3D Scene Generation From a Single Image and ActionsZizhang Li, Hong-Xing Yu, Wei Liu, Yin Yang 等ICCV 2025 · 被引用 10 次
- Infinite Nature: Perpetual View Generation of Natural Scenes from a Single ImageAndrew Liu, Ameesh Makadia, Richard Tucker, Noah Snavely 等ICCV 2021 · 被引用 260 次
- Code2Worlds: Empowering Coding LLMs for 4D World GenerationYi Zhang, Yunshuang Wang, Zeyu Zhang, Hao TangICML 2026 · 被引用 6 次
- Physical Simulator In-the-Loop Video GenerationLin Geng Foo, Mark He Huang, Alexandros Lattas, Stylianos Moschoglou 等CVPR 2026 · 被引用 13 次
- Perceptual 3D Simulation With Physical World ModelingWanhee Lee, Klemen Kotar, Rahul Mysore Venkatesh, Jared Watrous 等CVPR 2026
