AntigenLM: Structure-Aware DNA Language Modeling for Influenza
Yue Pei, Xuebin Chi, Yu Kang
摘要
Language models have advanced sequence analysis, yet DNA foundation models often lag behind task-specific methods for unclear reasons. We present Anti-genLM, a generative DNA language model pretrained on influenza genomes with intact, aligned functional units. This structure-aware pretraining enables Anti-genLM to capture evolutionary constraints and generalize across tasks. Finetuned on time-series hemagglutinin (HA) and neuraminidase (NA) sequences, AntigenLM accurately forecasts future antigenic variants across regions and subtypes, including those unseen during training, outperforming phylogenetic and evolution-based models. It also achieves near-perfect subtype classification. Ablation studies show that disrupting genomic structure through fragmentation or shuffling severely degrades performance, revealing the importance of preserving functional-unit integrity in DNA language modeling. AntigenLM thus provides both a powerful framework for antigen evolution prediction and a general principle for building biologically grounded DNA foundation models.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper2
- DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species GenomesZhihan Zhou, Yanrong Ji, Weijian Li, Pratik Dutta 等ICLR 2024 · 被引用 67 次
- VQDNA: Unleashing the Power of Vector Quantization for Multi-Species Genomic Sequence ModelingSiyuan Li, Zedong Wang, Zicheng Liu, Di Wu 等ICML 2024 · 被引用 19 次
相关 Paper
- HELM: Hierarchical Encoding for mRNA Language ModelingMehdi Yazdani-Jahromi, Mangal Prakash, Tommaso Mansi, Artem Moskalev 等ICLR 2025
- Predicting evolutionary rate as a pretraining task improves genome language model representationsMica Consens, Kevin Yang, James Hall, Ashley Conard 等ICML 2026
- One protein is all you needAnton Bushuiev, Roman Bushuiev, Olga Pimenova, Nikola Zadorozhny 等ICLR 2026 · 被引用 1 次
- On Pre-training Language Model for AntibodyDanqing Wang, Fei Ye, Hao ZhouICLR 2023 · 被引用 12 次
- Pre-training Antibody Language Models for Antigen-Specific Computational Antibody DesignKaiyuan Gao, Lijun Wu, Jinhua Zhu, Tianbo Peng 等KDD 2023 · 被引用 12 次
