Lune

ICCV2025Top-tier venue

I2I^{\mathbf{2}}-World: Intra-Inter Tokenization for Efficient Dynamic 4D Scene Forecasting

Zhimin Liao, Ping Wei, Ruijie Zhang, Shuaijia Chen, Haoxuan Wang, Ziyang Ren

2025Year
1Citations
2Top-tier citations

Abstract

Forecasting the evolution of 3D scenes and generating unseen scenarios via occupancy-based world models offer substantial potential for addressing corner cases in autonomous driving systems. While tokenization has revolutionized image and video generation, efficiently tokenizing complex 3D scenes remains a critical challenge for 3D world models. To address this issue, we propose I2I^{2}-World, an efficient framework for 4D occupancy forecasting. Our method decouples scene tokenization into intra-scene and inter-scene tokenizers. The intra-scene tokenizer employs a multi-scale residual quantization strategy to hierarchically compress 3D3 D scenes while preserving spatial details. The inter-scene tokenizer residually aggregates temporal dependencies across timesteps. This dual design preserves the compactness of 3D tokenizers while retaining the dynamic expressiveness of 4D tokenizers. Unlike decoder-only GPT-style autoregressive models, I2I^{2}-World adopts an encoder-decoder architecture. The encoder aggregates spatial context from the current scene and predicts a transformation matrix to enable high-level control over scene generation. The decoder, conditioned on transformation matrix and historical tokens, ensures temporal consistency during generation. Experiments demonstrate that I2I^{2}-World achieves state-of-theart performance, outperforming existing methods by 25.1%\mathbf{2 5. 1 {\%}} in mIoUm I o U and 36.9% in IoUI o U for 4D occupancy forecasting while exhibiting exceptional computational efficiency. It nearly requires 2.9 GB of training memory and achieves real-time inference at 37.0 FPS. Our code is available on https://github.com/lzzzzzm/II-World.

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

Questions to start from

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

lune papers fulltext 89aa15f3-db5c-4683-8c72-4f0285115fc9

Cited by top-tier papers2

Ask how each one uses it

Builds on28

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines