BallGAN: 3D-aware Image Synthesis with a Spherical Background
Minjung Shin, Yunji Seo, Jeongmin Bae, Young Sun Choi, Hyunsu Kim, Hyeran Byun, Youngjung Uh
Abstract
3D-aware GANs aim to synthesize realistic 3D scenes that can be rendered in arbitrary camera viewpoints, generating high-quality images with well-defined geometry. As 3D content creation becomes more popular, the ability to generate foreground objects separately from the background has become a crucial property. Existing methods have been developed regarding overall image quality, but they can not generate foreground objects only and often show degraded 3D geometry. In this work, we propose to represent the background as a spherical surface for multiple reasons inspired by computer graphics. Our method naturally provides foreground-only 3D synthesis facilitating easier 3D content creation. Furthermore, it improves the foreground geometry of 3D-aware GANs and the training stability on datasets with complex backgrounds. Project page: https://minjung-s.github.io/ballgan/
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- LPFF: A Portrait Dataset for Face Generators Across Large PosesYiqian Wu, Jing Zhang, Hongbo Fu, Xiaogang JinICCV 2023 · 29 citations
- OrthoPlanes: A Novel Representation for Better 3D-Awareness of GANsHonglin He, Zhuoqian Yang, Shikai Li, Bo Dai et al.ICCV 2023 · 9 citations
- 3D-Aware Generative Model for Improved Side-View Image SynthesisKyungmin Jo, Wonjoon Jin, Jaegul Choo, Hyunjoon Lee et al.ICCV 2023 · 5 citations
- MVCustom: Multi-View Customized Diffusion via Geometric Latent Rendering and CompletionMinjung Shin, Hyunin Cho, Sooyeon Go, Jin-Hwa Kim et al.ICLR 2026 · 3 citations
Builds on30
- Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional DomainsMatthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil et al.NeurIPS 2020 · 4,036 citations
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman et al.ICCV 2021 · 2,700 citations
- Alias-Free Generative Adversarial NetworksTero Karras, Miika Aittala, Samuli Laine, Erik Härkönen et al.NeurIPS 2021 · 2,126 citations
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan et al.CVPR 2022 · 1,603 citations
- StyleCLIP: Text-Driven Manipulation of StyleGAN ImageryOr Patashnik, Zongze Wu, Eli Shechtman, Daniel Cohen-Or et al.ICCV 2021 · 1,437 citations
Related papers
- BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled ImagesThu Nguyen-Phuoc, Christian Richardt, Long Mai, Yong-Liang Yang et al.NeurIPS 2020 · 256 citations
- DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene SynthesisYinghao Xu, Menglei Chai, Zifan Shi, Sida Peng et al.CVPR 2023
- In-N-Out: Faithful 3D GAN Inversion with Volumetric Decomposition for Face EditingYiran Xu, Zhixin Shu, Cameron Smith, Seoung Wug Oh et al.CVPR 2024 · 5 citations
- SP-GAN: sphere-guided 3D shape generation and manipulationRuihui Li, Xianzhi Li, Ka-Hei Hui, Chi-Wing FuSIGGRAPH 2021 · 61 citations
- Pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image SynthesisEric R. Chan, Marco Monteiro, Petr Kellnhofer, Jiajun Wu et al.CVPR 2021
