Toward Richer Material Generation via Procedural Data Enhancement
Yunchen Yu, Jacob Munkberg, Jon Hasselgren, Chris Cummings, Steve Marschner, Andrea Weidlich
Abstract
is represented by two latent textures and decoded by a pretrained universal MLP. We further regularize the latent space to support material generation.
The resulting neural material dataset enables training generative models for richer material creation. To demonstrate this application, we finetune a video diffusion model to produce neural latent textures that encode our multi-lobe material, and present generative results as proof of feasibility. Our procedural data enhancement approach is an important step toward improving expressivity in material generation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on24
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- Video Diffusion ModelsJonathan Ho, Tim Salimans, Alexey A. Gritsenko, William Chan et al.NeurIPS 2022 · 2,948 citations
- MVDream: Multi-view Diffusion for 3D GenerationYichun Shi, Peng Wang, Jianglong Ye, Long Mai et al.ICLR 2024 · 973 citations
- Text2Tex: Text-driven Texture Synthesis via Diffusion ModelsDave Zhenyu Chen, Yawar Siddiqui, Hsin-Ying Lee, Sergey Tulyakov et al.ICCV 2023 · 262 citations
Related papers
- Generative Neural MaterialsNithin Raghavan, Krishna Mullia, Alexander Trevithick, Fujun Luan et al.SIGGRAPH 2025 · 3 citations
- VideoNeuMat: Neural Material Extraction from Generative Video ModelsBowen Xue, Saeed Hadadan, Zheng Zeng, Fabrice Rousselle et al.SIGGRAPH 2026
- VLMaterial: Procedural Material Generation with Large Vision-Language ModelsBeichen Li, Rundi Wu, Armando Solar-Lezama, Changxi Zheng et al.ICLR 2025
- MatLat: Material Latent Space for PBR Texture GenerationKyeongmin Yeo, Yunhong Min, Jaihoon Kim, Minhyuk SungCVPR 2026 · 2 citations
- Generating Procedural Materials from Text or Image PromptsYiwei Hu, Paul Guerrero, Milos Hasan, Holly E. Rushmeier et al.SIGGRAPH 2023 · 26 citations
