Explicit representation of germline and non-germline residues improves antibody language modeling
Jeonghyeon Kim, Nathaniel Blalock, Ameya Kulkarni, Kensuke Nakamura, Philip Romero
Abstract
Antibodies originate from germline templates and are diversified by somatic hypermutation, producing sequences in which conserved germline residues scaffold structure while rare non-germline (NGL) substitutions refine antigen binding. Current antibody language models (ALMs) treat all residues equivalently and inherit a germline bias that systematically down-weights functionally critical NGL mutations as statistical noise. We introduce PRISM, a germline-aware ALM that explicitly represents germline and non-germline residues as distinct token types over a factorized 53-token vocabulary. PRISM achieves state-of-the-art pseudo-perplexity in hypervariable CDRs and is uniquely positively correlated with experimental binding affinity across three deep mutational scanning landscapes on which all compared ALMs anti-correlate. The dual-vocabulary further enables property-specific controllable generation previously unattainable with entangled ALMs. NGL-directed sampling improves physics-based binding scores while GL-directed sampling preserves stability and solubility. These results establish disentangled germline/non-germline representation as a substantive advance in antibody language modeling.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itRelated papers
- Synergy of GFlowNet and Protein Language Model Makes a Diverse Antibody DesignerMingze Yin, Hanjing Zhou, Yiheng Zhu, Jialu Wu et al.AAAI 2025 · 3 citations
- Antibody Design Using a Score-based Diffusion Model Guided by Evolutionary, Physical and Geometric ConstraintsTian Zhu, Milong Ren, Haicang ZhangICML 2024 · 13 citations
- Reprogramming Pretrained Language Models for Antibody Sequence InfillingIgor Melnyk, Vijil Chenthamarakshan, Pin-Yu Chen, Payel Das et al.ICML 2023 · 40 citations
- On Pre-training Language Model for AntibodyDanqing Wang, Fei Ye, Hao ZhouICLR 2023 · 12 citations
- Pre-training Antibody Language Models for Antigen-Specific Computational Antibody DesignKaiyuan Gao, Lijun Wu, Jinhua Zhu, Tianbo Peng et al.KDD 2023 · 12 citations
