CrystalICL: Enabling In-Context Learning for Crystal Generation
Ruobing Wang, Qiaoyu Tan, Yili Wang, Ying Wang, Xin Wang
Abstract
Designing crystal materials with desired physicochemical properties remains a fundamental challenge in materials science. While large language models (LLMs) have demonstrated strong in-context learning (ICL) capabilities, existing LLM-based crystal generation approaches are limited to zero-shot scenarios and are unable to benefit from few-shot scenarios. In contrast, human experts typically design new materials by modifying relevant known structures which aligns closely with the few-shot ICL paradigm. Motivated by this, we propose CrystalICL, a novel model designed for few-shot crystal generation. Specifically, we introduce a space-group based crystal tokenization method, which effectively reduces the complexity of modeling crystal symmetry in LLMs. We further introduce a condition-structure aware hybrid instruction tuning framework and a multi-task instruction tuning strategy, enabling the model to better exploit ICL by capturing structure-property relationships from limited data. Extensive experiments on four crystal generation benchmarks demonstrate the superiority of CrystalICL over the leading baseline methods on conditional and unconditional generation tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 996e9f16-73cc-4c9f-8c8d-4e782e01998eCited by top-tier papers1
Ask how each one uses itBuilds on6
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- Crystal Diffusion Variational Autoencoder for Periodic Material GenerationTian Xie, Xiang Fu, Octavian-Eugen Ganea, Regina Barzilay et al.ICLR 2022 · 394 citations
- Crystal Structure Prediction by Joint Equivariant DiffusionRui Jiao, Wenbing Huang, Peijia Lin, Jiaqi Han et al.NeurIPS 2023 · 245 citations
- Fine-Tuned Language Models Generate Stable Inorganic Materials as TextNate Gruver, Anuroop Sriram, Andrea Madotto, Andrew Gordon Wilson et al.ICLR 2024 · 120 citations
- Space Group Constrained Crystal GenerationRui Jiao, Wenbing Huang, Yu Liu, Deli Zhao et al.ICLR 2024 · 78 citations
Related papers
- LLM Meets Diffusion: A Hybrid Framework for Crystal Material GenerationSubhojyoti Khastagir, Kishalay Das, Pawan Goyal, Seung-Cheol Lee et al.NeurIPS 2025 · 14 citations
- Enhancing Activity Prediction Models in Drug Discovery with the Ability to Understand Human LanguagePhilipp Seidl, Andreu Vall, Sepp Hochreiter, Günter KlambauerICML 2023 · 69 citations
- GraphLAMA: Enabling Efficient Adaptation of Graph Language Models with Limited AnnotationsJunze Chen, Cheng Yang, Shujie Li, Zhiqiang Zhang et al.KDD 2025 · 1 citation
- HeGTa: Leveraging Heterogeneous Graph-enhanced Large Language Models for Few-shot Complex Table UnderstandingRihui Jin, Yu Li, Guilin Qi, Nan Hu et al.AAAI 2025 · 1 citation
- Controlled Text Generation with Natural Language InstructionsWangchunshu Zhou, Yuchen Eleanor Jiang, Ethan Wilcox, Ryan Cotterell et al.ICML 2023 · 121 citations
