Property-Informed Diffusion-Based Text-to-Microstructure Generation
Bingxuan Dai, Hongsong Wang, Jie Gui
Abstract
Designing 3D metamaterial microstructures that meet the intended functions remains a major challenge, as it typically requires domain expertise, iterative simulations, and extensive manual tuning. Existing work on inverse design that automatically generates microstructures based on desired target properties often suffers from limited design diversity and faces challenges in ensuring the physical feasibility of the generated structures. To address this issue, a property-informed diffusion-based network is proposed that enables the generation of 3D microstructures directly from textual descriptions. Unlike traditional property conditioning methods, our approach leverages rich guidance in terms of semantics and physical properties in the text input to support diverse structure synthesis. To enforce consistency between the generated structures and the target textual prompts, a dual alignment strategy is adopted, including contrastive text-structure alignment and test-time reward-guided alignment. Experimental results show that the model is capable of generating semantically meaningful and physically plausible structures across a wide range of material categories. Our approach has good potential for interactive microstructure design and opens up new directions for combining language-based interfaces with inverse material discovery. Code is available at: https:// github.com/hongsong-wang/PropDiff-TMG.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d887fc39-ba4f-41c2-b5c8-4299f272c665Builds on19
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- LION: Latent Point Diffusion Models for 3D Shape GenerationXiaohui Zeng, Arash Vahdat, Francis Williams, Zan Gojcic et al.NeurIPS 2022 · 752 citations
- CAT3D: Create Anything in 3D with Multi-View Diffusion ModelsRuiqi Gao, Aleksander Holynski, Philipp Henzler, Arthur Brussee et al.NeurIPS 2024 · 490 citations
Related papers
- MIND: Microstructure INverse Design with Generative Hybrid Neural RepresentationTianyang Xue, Longdu Liu, Lin Lu, Paul Henderson et al.SIGGRAPH 2025 · 4 citations
- PRO-MOF: Policy Optimization with Universal Atomistic Models for Controllable MOF GenerationZicheng Liu, Ben Fei, Di HuangICLR 2026
- Conditional Synthesis of 3D Molecules with Time Correction SamplerHojung Jung, Youngrok Park, Laura Schmid, Jaehyeong Jo et al.NeurIPS 2024 · 8 citations
- Generative Hierarchical Materials SearchSherry Yang, Simon L. Batzner, Ruiqi Gao, Muratahan Aykol et al.NeurIPS 2024 · 23 citations
- MaPa: Text-driven Photorealistic Material Painting for 3D ShapesShangzhan Zhang, Sida Peng, Tao Xu, Yuanbo Yang et al.SIGGRAPH 2024 · 15 citations
