CrystalDiT: Simple Diffusion Transformers for Crystal Generation
Xiaohan Yi, Guikun Xu, Zhong Zhang, Liu Liu, Yatao Bian, Xi Xiao, Peilin Zhao
Abstract
We present CrystalDiT, a diffusion transformer for crystal structure generation that achieves state-of-the-art performance by challenging the trend of architectural complexity. Instead of intricate, multi-stream designs, CrystalDiT employs a unified transformer that imposes a powerful inductive bias: treating lattice and atomic properties as a single, interdependent system. Combined with a periodic table-based atomic representation and a balanced training strategy, our approach achieves 8.78% SUN (Stable, Unique, Novel) rate on MP-20, substantially outperforming recent methods including FlowMM (4.21%) and MatterGen (3.66%). Notably, CrystalDiT generates 63.28% unique and novel structures while maintaining comparable stability rates, demonstrating that architectural simplicity can be more effective than complexity for materials discovery. Our results suggest that in data-limited scientific domains, carefully designed simple architectures outperform sophisticated alternatives that are prone to overfitting.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d665476c-4a8c-45d1-b201-a7acdbc207daBuilds on16
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
- Structured Denoising Diffusion Models in Discrete State-SpacesJacob Austin, Daniel D. Johnson, Jonathan Ho, Daniel Tarlow et al.NeurIPS 2021 · 2,256 citations
- Crystal Diffusion Variational Autoencoder for Periodic Material GenerationTian Xie, Xiang Fu, Octavian-Eugen Ganea, Regina Barzilay et al.ICLR 2022 · 394 citations
- Adversarial Sparse Transformer for Time Series ForecastingSifan Wu, Xi Xiao, Qianggang Ding, Peilin Zhao et al.NeurIPS 2020 · 264 citations
- Crystal Structure Prediction by Joint Equivariant DiffusionRui Jiao, Wenbing Huang, Peijia Lin, Jiaqi Han et al.NeurIPS 2023 · 245 citations
Related papers
- All-atom Diffusion Transformers: Unified generative modelling of molecules and materialsChaitanya K. Joshi, Xiang Fu, Yi-Lun Liao, Vahe Gharakhanyan et al.ICML 2025
- FlowMM: Generating Materials with Riemannian Flow MatchingBenjamin Kurt Miller, Ricky T. Q. Chen, Anuroop Sriram, Brandon M. WoodICML 2024 · 101 citations
- LLM Meets Diffusion: A Hybrid Framework for Crystal Material GenerationSubhojyoti Khastagir, Kishalay Das, Pawan Goyal, Seung-Cheol Lee et al.NeurIPS 2025 · 14 citations
- Scalable Diffusion for Materials GenerationSherry Yang, KwangHwan Cho, Amil Merchant, Pieter Abbeel et al.ICLR 2024 · 77 citations
- SymmCD: Symmetry-Preserving Crystal Generation with Diffusion ModelsDaniel Levy, Siba Smarak Panigrahi, Sékou-Oumar Kaba, Qiang Zhu et al.ICLR 2025
