Deep geometric texture synthesis
Amir Hertz, Rana Hanocka, Raja Giryes, Daniel Cohen-Or
Abstract
Recently, deep generative adversarial networks for image generation have advanced rapidly; yet, only a small amount of research has focused on generative models for irregular structures, particularly meshes. Nonetheless, mesh generation and synthesis remains a fundamental topic in computer graphics. In this work, we propose a novel framework for synthesizing geometric textures. It learns geometric texture statistics from local neighborhoods ( i.e. , local triangular patches) of a single reference 3D model. It learns deep features on the faces of the input triangulation, which is used to subdivide and generate offsets across multiple scales, without parameterization of the reference or target mesh. Our network displaces mesh vertices in any direction ( i.e. , in the normal and tangential direction), enabling synthesis of geometric textures, which cannot be expressed by a simple 2D displacement map. Learning and synthesizing on local geometric patches enables a genus-oblivious framework, facilitating texture transfer between shapes of different genus.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers27
- TEXTure: Text-Guided Texturing of 3D ShapesElad Richardson, Gal Metzer, Yuval Alaluf, Raja Giryes et al.SIGGRAPH 2023 · 196 citations
- TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting DecompositionYongwei Chen, Rui Chen, Jiabao Lei, Yabin Zhang et al.NeurIPS 2022 · 112 citations
- 3DStyleNet: Creating 3D Shapes with Geometric and Texture Style VariationsKangxue Yin, Jun Gao, Maria Shugrina, Sameh Khamis et al.ICCV 2021 · 87 citations
- Geometry-Consistent Neural Shape Representation with Implicit Displacement FieldsYifan Wang, Lukas Rahmann, Olga Sorkine-HornungICLR 2022 · 81 citations
- HodgeNet: learning spectral geometry on triangle meshesDmitriy Smirnov, Justin SolomonSIGGRAPH 2021 · 68 citations
Builds on5
- Test-Time Training with Self-Supervision for Generalization under Distribution ShiftsYu Sun, Xiaolong Wang, Zhuang Liu, John Miller et al.ICML 2020 · 1,220 citations
- SinGAN: Learning a Generative Model From a Single Natural ImageTamar Rott Shaham, Tali Dekel, Tomer MichaeliICCV 2019 · 933 citations
- PointFlow: 3D Point Cloud Generation With Continuous Normalizing FlowsGuandao Yang, Xun Huang, Zekun Hao, Ming-Yu Liu et al.ICCV 2019 · 794 citations
- BSP-Net: Generating Compact Meshes via Binary Space PartitioningZhiqin Chen, Andrea Tagliasacchi, Hao ZhangCVPR 2020
- PointGMM: A Neural GMM Network for Point CloudsAmir Hertz, Rana Hanocka, Raja Giryes, Daniel Cohen-OrCVPR 2020
Related papers
- Learning Generative Models of Textured 3D Meshes from Real-World ImagesDario Pavllo, Jonas Kohler, Thomas Hofmann, Aurélien LucchiICCV 2021 · 57 citations
- Texture Fields: Learning Texture Representations in Function SpaceMichael Oechsle, Lars M. Mescheder, Michael Niemeyer, Thilo Strauss et al.ICCV 2019 · 334 citations
- GramGAN: Deep 3D Texture Synthesis From 2D ExemplarsTiziano Portenier, Siavash Arjomand Bigdeli, Orcun GokselNeurIPS 2020 · 32 citations
- MeshNet++: A Network with a FaceVinit Veerendraveer Singh, Shivanand Venkanna Sheshappanavar, Chandra KambhamettuACM MM 2021 · 25 citations
- AUV-Net: Learning Aligned UV Maps for Texture Transfer and SynthesisZhiqin Chen, Kangxue Yin, Sanja FidlerCVPR 2022 · 26 citations
