Lune

EMNLP Findings2025

Protein Large Language Models: A Comprehensive Survey

Yijia Xiao, Wanjia Zhao, Junkai Zhang, Yiqiao Jin, Han Zhang, Zhicheng Ren, Renliang Sun, Haixin Wang, Guancheng Wan, Pan Lu, Xiao Luo, Yu Zhang

Abstract

Protein-specific large language models (Protein LLMs) are revolutionizing protein science by enabling more efficient protein structure prediction, function annotation, and design. While existing surveys focus on specific aspects or applications, this work provides the first comprehensive overview of Protein LLMs, covering their architectures, training datasets, evaluation metrics, and diverse applications. Through a systematic analysis of over 100 articles, we propose a structured taxonomy of state-of-theart Protein LLMs, analyze how they leverage large-scale protein sequence data for improved accuracy, and explore their potential in advancing protein engineering and biomedical research. Additionally, we discuss key challenges and future directions, positioning Protein LLMs as essential tools for scientific discovery in protein science. Resources are maintained at https://github.com/Yijia-Xiao/ Protein-LLM-Survey.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Learning inverse folding from millions of predicted structures cites Learning from Protein Structure with Geometric Vector Perceptrons
  • Learning inverse folding from millions of predicted structures cites Language models enable zero-shot prediction of the effects of mutations on protein function
  • Language models enable zero-shot prediction of the effects of mutations on protein function cites BERTology Meets Biology: Interpreting Attention in Protein Language Models
  • SaProt: Protein Language Modeling with Structure-aware Vocabulary cites BERTology Meets Biology: Interpreting Attention in Protein Language Models
  • SaProt: Protein Language Modeling with Structure-aware Vocabulary cites Learning inverse folding from millions of predicted structures
  • SaProt: Protein Language Modeling with Structure-aware Vocabulary cites Language models enable zero-shot prediction of the effects of mutations on protein function
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. BIOARC: Discovering Optimal Neural Architectures for Biological Foundation ModelsYi Fang, Haoran Xu, Jiaxin Han, Sirui Ding et al.ICML 2026

Builds on18

  1. Language models enable zero-shot prediction of the effects of mutations on protein functionJoshua Meier, Roshan Rao, Robert Verkuil, Jason Liu et al.NeurIPS 2021 · 969 citations
  2. Learning from Protein Structure with Geometric Vector PerceptronsBowen Jing, Stephan Eismann, Patricia Suriana, Raphael John Lamarre Townshend et al.ICLR 2021 · 627 citations
  3. Learning inverse folding from millions of predicted structuresChloe Hsu, Robert Verkuil, Jason Liu, Zeming Lin et al.ICML 2022 · 560 citations
  4. BERTology Meets Biology: Interpreting Attention in Protein Language ModelsJesse Vig, Ali Madani, Lav R. Varshney, Caiming Xiong et al.ICLR 2021 · 357 citations
  5. SaProt: Protein Language Modeling with Structure-aware VocabularyJin Su, Chenchen Han, Yuyang Zhou, Junjie Shan et al.ICLR 2024 · 285 citations

Related papers

  1. A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific DiscoveryYu Zhang, Xiusi Chen, Bowen Jin, Sheng Wang et al.EMNLP 2024 · 28 citations
  2. Large Language Models in Bioinformatics: A SurveyZhenyu Wang, Zikang Wang, Jiyue Jiang, Pengan Chen et al.ACL Findings 2025 · 11 citations
  3. InstructProtein: Aligning Human and Protein Language via Knowledge InstructionZeyuan Wang, Qiang Zhang, Keyan Ding, Ming Qin et al.ACL 2024
  4. STELLA: A Multimodal LLM for Protein Functional Annotation via Unified Sequence-Structure EncodingHongwang Xiao, Wenjun Lin, Xi Chen, Hui Wang et al.ACL Findings 2026 · 2 citations
  5. A Survey of Large Language Models for Text-Guided Molecular Discovery: From Molecule Generation to OptimizationZiqing Wang, Kexin Zhang, Zihan Zhao, Yibo Wen et al.ACL 2026 · 10 citations
Dusk over the sea between two cliffs drawn in fine vertical lines