PerpetualWonder: Long-horizon Action-conditioned 4D Scene Generation
Jiahao Zhan, Zizhang Li, Hong-Xing Yu, Jiajun Wu
Abstract
We introduce PerpetualWonder, a hybrid generative simulator that enables long-horizon, action-conditioned 4D scene generation from a single image. Current works fail at this task because their physical state is decoupled from their visual representation, which prevents generative refinements to update the underlying physics for subsequent interactions. PerpetualWonder solves this by introducing the first true closed-loop system. It features a novel unified representation that creates a bidirectional link between the physical state and visual primitives, allowing generative refinements to correct both the dynamics and appearance. It also introduces a robust update mechanism that gathers supervision from multiple viewpoints to resolve optimization ambiguity. Experiments demonstrate that from a single image, PerpetualWonder can successfully simulate complex, multi-step interactions from long-horizon actions, maintaining physical plausibility and visual consistency.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5c4c5138-ccf5-461d-ac21-d4121d4675a6Cited by top-tier papers1
Ask how each one uses itBuilds on31
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Nerfies: Deformable Neural Radiance FieldsKeunhong Park, Utkarsh Sinha, Jonathan T. Barron, Sofien Bouaziz et al.ICCV 2021 · 1,442 citations
- Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian SplattingZeyu Yang, Hongye Yang, Zijie Pan, Li ZhangICLR 2024 · 529 citations
- 4D Gaussian Splatting for Real-Time Dynamic Scene RenderingGuanjun Wu, Taoran Yi, Jiemin Fang, Lingxi Xie et al.CVPR 2024 · 513 citations
- Text-To-4D Dynamic Scene GenerationUriel Singer, Shelly Sheynin, Adam Polyak, Oron Ashual et al.ICML 2023 · 234 citations
Related papers
- Wonderplay: Dynamic 3D Scene Generation From a Single Image and ActionsZizhang Li, Hong-Xing Yu, Wei Liu, Yin Yang et al.ICCV 2025 · 10 citations
- Infinite Nature: Perpetual View Generation of Natural Scenes from a Single ImageAndrew Liu, Ameesh Makadia, Richard Tucker, Noah Snavely et al.ICCV 2021 · 260 citations
- Code2Worlds: Empowering Coding LLMs for 4D World GenerationYi Zhang, Yunshuang Wang, Zeyu Zhang, Hao TangICML 2026 · 6 citations
- Physical Simulator In-the-Loop Video GenerationLin Geng Foo, Mark He Huang, Alexandros Lattas, Stylianos Moschoglou et al.CVPR 2026 · 13 citations
- Perceptual 3D Simulation With Physical World ModelingWanhee Lee, Klemen Kotar, Rahul Mysore Venkatesh, Jared Watrous et al.CVPR 2026
