AntigenLM: Structure-Aware DNA Language Modeling for Influenza
Yue Pei, Xuebin Chi, Yu Kang
Abstract
Language models have advanced sequence analysis, yet DNA foundation models often lag behind task-specific methods for unclear reasons. We present Anti-genLM, a generative DNA language model pretrained on influenza genomes with intact, aligned functional units. This structure-aware pretraining enables Anti-genLM to capture evolutionary constraints and generalize across tasks. Finetuned on time-series hemagglutinin (HA) and neuraminidase (NA) sequences, AntigenLM accurately forecasts future antigenic variants across regions and subtypes, including those unseen during training, outperforming phylogenetic and evolution-based models. It also achieves near-perfect subtype classification. Ablation studies show that disrupting genomic structure through fragmentation or shuffling severely degrades performance, revealing the importance of preserving functional-unit integrity in DNA language modeling. AntigenLM thus provides both a powerful framework for antigen evolution prediction and a general principle for building biologically grounded DNA foundation models.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on2
- DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species GenomesZhihan Zhou, Yanrong Ji, Weijian Li, Pratik Dutta et al.ICLR 2024 · 67 citations
- VQDNA: Unleashing the Power of Vector Quantization for Multi-Species Genomic Sequence ModelingSiyuan Li, Zedong Wang, Zicheng Liu, Di Wu et al.ICML 2024 · 19 citations
Related papers
- HELM: Hierarchical Encoding for mRNA Language ModelingMehdi Yazdani-Jahromi, Mangal Prakash, Tommaso Mansi, Artem Moskalev et al.ICLR 2025
- Predicting evolutionary rate as a pretraining task improves genome language model representationsMica Consens, Kevin Yang, James Hall, Ashley Conard et al.ICML 2026
- One protein is all you needAnton Bushuiev, Roman Bushuiev, Olga Pimenova, Nikola Zadorozhny et al.ICLR 2026 · 1 citation
- On Pre-training Language Model for AntibodyDanqing Wang, Fei Ye, Hao ZhouICLR 2023 · 12 citations
- Pre-training Antibody Language Models for Antigen-Specific Computational Antibody DesignKaiyuan Gao, Lijun Wu, Jinhua Zhu, Tianbo Peng et al.KDD 2023 · 12 citations
