Illuminating Mario Scenes in the Latent Space of a Generative Adversarial Network
Matthew C. Fontaine, Ruilin Liu, Ahmed Khalifa, Jignesh Modi, Julian Togelius, Amy K. Hoover, Stefanos Nikolaidis
Abstract
Generative adversarial networks (GANs) are quickly becoming a ubiquitous approach to procedurally generating video game levels. While GAN generated levels are stylistically similar to human-authored examples, human designers often want to explore the generative design space of GANs to extract interesting levels. However, human designers find latent vectors opaque and would rather explore along dimensions the designer specifies, such as number of enemies or obstacles. We propose using state-of-the-art quality diversity algorithms designed to optimize continuous spaces, i.e. MAP-Elites with a directional variation operator and Covariance Matrix Adaptation MAP-Elites, to efficiently explore the latent space of a GAN to extract levels that vary across a set of specified gameplay measures. In the benchmark domain of Super Mario Bros, we demonstrate how designers may specify gameplay measures to our system and extract high-quality (playable) levels with a diverse range of level mechanics, while still maintaining stylistic similarity to human authored examples. An online user study shows how the different mechanics of the automatically generated levels affect subjective ratings of their perceived difficulty and appearance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 65ea00f2-013a-4409-b7c3-90237923424aCited by top-tier papers15
- Differentiable Quality DiversityMatthew C. Fontaine, Stefanos NikolaidisNeurIPS 2021 · 116 citations
- MarioGPT: Open-Ended Text2Level Generation through Large Language ModelsShyam Sudhakaran, Miguel González Duque, Matthias Freiberger, Claire Glanois et al.NeurIPS 2023 · 112 citations
- Deep Surrogate Assisted Generation of EnvironmentsVarun Bhatt, Bryon Tjanaka, Matthew C. Fontaine, Stefanos NikolaidisNeurIPS 2022 · 54 citations
- Arbitrarily Scalable Environment Generators via Neural Cellular AutomataYulun Zhang, Matthew C. Fontaine, Varun Bhatt, Stefanos Nikolaidis et al.NeurIPS 2023 · 21 citations
- Sample-Efficient Quality-Diversity by Cooperative CoevolutionKe Xue, Ren-Jian Wang, Pengyi Li, Dong Li et al.ICLR 2024 · 17 citations
Builds on2
Related papers
- Method for Exploring Generative Adversarial Networks (GANs) via Automatically Generated Image GalleriesEnhao Zhang, Nikola BanovicCHI 2021 · 28 citations
- LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable DirectionsOguz Kaan Yüksel, Enis Simsar, Ezgi Gülperi Er, Pinar YanardagICCV 2021 · 71 citations
- Exploiting Spatial Dimensions of Latent in GAN for Real-Time Image EditingHyunsu Kim, Yunjey Choi, Junho Kim, Sungjoo Yoo et al.CVPR 2021
- UniGAN: Reducing Mode Collapse in GANs using a Uniform GeneratorZiqi Pan, Li Niu, Liqing ZhangNeurIPS 2022 · 17 citations
- Discovering Density-Preserving Latent Space Walks in GANs for Semantic Image TransformationsGuanyue Li, Yi Liu, Xiwen Wei, Yang Zhang et al.ACM MM 2021 · 7 citations
