SurfGen: Adversarial 3D Shape Synthesis with Explicit Surface Discriminators
Andrew Luo, Tianqin Li, Wen-Hao Zhang, Tai Sing Lee
Abstract
Recent advances in deep generative models have led to immense progress in 3D shape synthesis. While existing models are able to synthesize shapes represented as voxels, point-clouds, or implicit functions, these methods only indirectly enforce the plausibility of the final 3D shape surface. Here we present a 3D shape synthesis framework (SurfGen) that directly applies adversarial training to the object surface. Our approach uses a differentiable spherical projection layer to capture and represent the explicit zero isosurface of an implicit 3D generator as functions defined on the unit sphere. By processing the spherical representation of 3D object surfaces with a spherical CNN in an adversarial setting, our generator can better learn the statistics of natural shape surfaces. We evaluate our model on largescale shape datasets, and demonstrate that the end-to-end trained model is capable of generating high fidelity 3D shapes with diverse topology. Code is available at https: //github.com/aluo-x/NeuralRaycaster .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e1eb5b75-ce4b-4008-b60f-29356d30e90eCited by top-tier papers12
- LION: Latent Point Diffusion Models for 3D Shape GenerationXiaohui Zeng, Arash Vahdat, Francis Williams, Zan Gojcic et al.NeurIPS 2022 · 752 citations
- GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from ImagesJun Gao, Tianchang Shen, Zian Wang, Wenzheng Chen et al.NeurIPS 2022 · 661 citations
- Instant3D: Fast Text-to-3D with Sparse-view Generation and Large Reconstruction ModelJiahao Li, Hao Tan, Kai Zhang, Zexiang Xu et al.ICLR 2024 · 408 citations
- Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent RepresentationZibo Zhao, Wen Liu, Xin Chen, Xianfang Zeng et al.NeurIPS 2023 · 279 citations
- TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion ModelsTianshi Cao, Karsten Kreis, Sanja Fidler, Nicholas Sharp et al.ICCV 2023 · 103 citations
Builds on9
- Soft Rasterizer: A Differentiable Renderer for Image-Based 3D ReasoningShichen Liu, Weikai Chen, Tianye Li, Hao LiICCV 2019 · 789 citations
- 3D Point Cloud Generative Adversarial Network Based on Tree Structured Graph ConvolutionsDong Wook Shu, Sung Woo Park, Junseok KwonICCV 2019 · 337 citations
- DeepSphere: a graph-based spherical CNNMichaël Defferrard, Martino Milani, Frédérick Gusset, Nathanaël PerraudinICLR 2020 · 100 citations
- Meshlet Priors for 3D Mesh ReconstructionAbhishek Badki, Orazio Gallo, Jan Kautz, Pradeep SenCVPR 2020
- DIST: Rendering Deep Implicit Signed Distance Function With Differentiable Sphere TracingShaohui Liu, Yinda Zhang, Songyou Peng, Boxin Shi et al.CVPR 2020
Related papers
- Deep Implicit Surface Point Prediction NetworksRahul Venkatesh, Tejan Karmali, Sarthak Sharma, Aurobrata Ghosh et al.ICCV 2021 · 57 citations
- SP-GAN: sphere-guided 3D shape generation and manipulationRuihui Li, Xianzhi Li, Ka-Hei Hui, Chi-Wing FuSIGGRAPH 2021 · 61 citations
- BallGAN: 3D-aware Image Synthesis with a Spherical BackgroundMinjung Shin, Yunji Seo, Jeongmin Bae, Young Sun Choi et al.ICCV 2023 · 7 citations
- Surface Networks via General CoversNiv Haim, Nimrod Segol, Heli Ben-Hamu, Haggai Maron et al.ICCV 2019 · 54 citations
- GEM3D: GEnerative Medial Abstractions for 3D Shape SynthesisDmitry Petrov, Pradyumn Goyal, Vikas Thamizharasan, Vladimir G. Kim et al.SIGGRAPH 2024 · 11 citations
