InfiniteDiffusion: Bridging Learned Fidelity and Procedural Utility for Open-World Terrain Generation
Alexander Goslin
Abstract
For decades, procedural worlds have been built on procedural noise functions such as Perlin noise, which are fast and infinite, yet fundamentally limited in realism and large-scale coherence. Conversely, diffusion models offer unprecedented fidelity but remain generally confined to bounded canvases. We introduce InfiniteDiffusion, a training-free algorithm that reformulates diffusion sampling for lazy and unbounded generation, bridging the fidelity of diffusion models with the properties that made procedural noise indispensable: seamless infinite extent, seed-consistency, and constant-time random access. To demonstrate the utility of this approach, we present Terrain Diffusion, a framework for learned procedural terrain generation with a procedural noise-like interface. Our framework outpaces orbital velocity by 9 times on a consumer GPU, enabling realistic terrain generation at interactive rates. We integrate a hierarchical stack of diffusion models to couple planetary context with local detail, a compact Laplacian encoding to stabilize outputs across Earth-scale dynamic ranges, and an open-source infinite-tensor framework for constant-memory manipulation of unbounded tensors. Together, these components position diffusion models as a practical foundation for the next generation of infinite virtual worlds.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on14
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Consistency ModelsYang Song, Prafulla Dhariwal, Mark Chen, Ilya SutskeverICML 2023 · 1,720 citations
- MultiDiffusion: Fusing Diffusion Paths for Controlled Image GenerationOmer Bar-Tal, Lior Yariv, Yaron Lipman, Tali DekelICML 2023 · 575 citations
- Guiding a Diffusion Model with a Bad Version of ItselfTero Karras, Miika Aittala, Tuomas Kynkäänniemi, Jaakko Lehtinen et al.NeurIPS 2024 · 338 citations
Related papers
- Terrain Diffusion Network: Climatic-Aware Terrain Generation with Geological Sketch GuidanceZexin Hu, Kun Hu, Clinton Mo, Lei Pan et al.AAAI 2024 · 8 citations
- ∞-Diff: Infinite Resolution Diffusion with Subsampled Mollified StatesSam Bond-Taylor, Chris G. WillcocksICLR 2024 · 28 citations
- Infinite Photorealistic Worlds Using Procedural GenerationAlexander Raistrick, Lahav Lipson, Zeyu Ma, Lingjie Mei et al.CVPR 2023
- Learning a Neural 3D Texture Space From 2D ExemplarsPhilipp Henzler, Niloy J. Mitra, Tobias RitschelCVPR 2020
- LT3SD: Latent Trees for 3D Scene DiffusionQuan Meng, Lei Li, Matthias Nießner, Angela DaiCVPR 2025
