Preference-based Antibody Expression Ranking: Scaling with Large-scale Weak Supervision
Josh Sun, Morteza Babaie, Wenyang hou, Mark Crowley, David Young
摘要
Antibody expression ranking is a critical task in antibody design, yet its modelling is severely hindered by the scarcity of labeled experimental data. To address this, we propose a unified preference-based learning framework that integrates scarce quantitative expression data with large-scale weak positive supervision from immunization data. We adapt Direct Preference Optimization (DPO) to protein language models by introducing a union-masked log-likelihood approximation and IMGT-based alignment, enabling efficient training on variable-length sequences. Evaluating on a diverse internal dataset of 1254 labeled sequences and 4 million unlabeled camelid-derived antibodies, we show that our method consistently outperforms baselines on most metrics. Our results demonstrate that preference learning can effectively learn from weak supervision, providing a scalable solution for antibody expressibility optimization in data-constrained settings. Project page: https://kisoji-biotechnology-inc.github.io/Preference-Expression-Ranking/.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper5
- Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning 等NeurIPS 2023 · 被引用 10,924 次
- Language models enable zero-shot prediction of the effects of mutations on protein functionJoshua Meier, Roshan Rao, Robert Verkuil, Jason Liu 等NeurIPS 2021 · 被引用 969 次
- Masked Language Model ScoringJulian Salazar, Davis Liang, Toan Q. Nguyen, Katrin KirchhoffACL 2020 · 被引用 167 次
- Protein Inverse Folding From Structure FeedbackJunde Xu, Zijun Gao, Xinyi Zhou, Jie Hu 等NeurIPS 2025 · 被引用 9 次
- Protein Language Model Fitness is a Matter of PreferenceCade W. Gordon, Amy X. Lu, Pieter AbbeelICLR 2025
相关 Paper
- Pareto-Optimal Energy Alignment for Designing Nature-Like AntibodiesYibo Wen, Chenwei Xu, Jerry Yao-Chieh Hu, Kaize Ding 等NeurIPS 2025
- Enhancing Safe and Controllable Protein Generation via Knowledge Preference OptimizationYuhao Wang, Keyan Ding, Kehua Feng, Zeyuan Wang 等ACL 2025 · 被引用 2 次
- Reprogramming Pretrained Language Models for Antibody Sequence InfillingIgor Melnyk, Vijil Chenthamarakshan, Pin-Yu Chen, Payel Das 等ICML 2023 · 被引用 40 次
- Uni-DPO: A Unified Paradigm for Dynamic Preference Optimization of LLMsShangpin Peng, Weinong Wang, Zhuotao Tian, Senqiao Yang 等ICLR 2026 · 被引用 10 次
- Antigen-Specific Antibody Design via Direct Energy-based Preference OptimizationXiangxin Zhou, Dongyu Xue, Ruizhe Chen, Zaixiang Zheng 等NeurIPS 2024 · 被引用 48 次
