Flexible Kernels for Protein Property Prediction
Martin Jankowiak, Yerdos Ordabayev, Rudraksh Tuwani, Henry Ward, Hunter Nisonoff, James McFarland, Gevorg Grigoryan
Abstract
Despite its importance to applications in protein design, predicting protein properties like binding affinity and thermostability from sparse experimental data remains a significant challenge. Accordingly, we introduce a class of sequence kernels that exploit evolutionary substitution matrices as well as local linearity and demonstrate that the resulting Gaussian processes provide data-efficient models of protein property landscapes, frequently outperforming alternatives that rely on foundation model embeddings. Furthermore--by learning what are in effect structure-aware substitution matrices--we show that our kernels can readily incorporate structural information from foundation models. We demonstrate that these structure-conditioned kernels are well suited to multi-task learning across multiple protein property landscapes and can decisively outperform local supervised learning methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on8
- Language models enable zero-shot prediction of the effects of mutations on protein functionJoshua Meier, Roshan Rao, Robert Verkuil, Jason Liu et al.NeurIPS 2021 · 969 citations
- BoTorch: A Framework for Efficient Monte-Carlo Bayesian OptimizationMaximilian Balandat, Brian Karrer, Daniel R. Jiang, Samuel Daulton et al.NeurIPS 2020 · 686 citations
- Accelerating Bayesian Optimization for Biological Sequence Design with Denoising AutoencodersSamuel Stanton, Wesley J. Maddox, Nate Gruver, Phillip M. Maffettone et al.ICML 2022 · 137 citations
- Feature Reuse and Scaling: Understanding Transfer Learning with Protein Language ModelsFrancesca-Zhoufan Li, Ava P. Amini, Yisong Yue, Kevin K. Yang et al.ICML 2024 · 61 citations
- A Langevin-like Sampler for Discrete DistributionsRuqi Zhang, Xingchao Liu, Qiang LiuICML 2022 · 51 citations
Related papers
- ProteinNPT: Improving protein property prediction and design with non-parametric transformersPascal Notin, Ruben Weitzman, Debora S. Marks, Yarin GalNeurIPS 2023 · 48 citations
- Physical Consistency Bridges Heterogeneous Data in Molecular Multi-Task LearningYuxuan Ren, Dihan Zheng, Chang Liu, Peiran Jin et al.NeurIPS 2024 · 3 citations
- PatchET: Learning Enzyme Temperature Properties Through Patch-Based Neural ArchitecturesZiqi Zhang, Runze Yang, Longbing Cao, Zhaohong DengAAAI 2026
- Retrieved Sequence Augmentation for Protein Representation LearningChang Ma, Haiteng Zhao, Lin Zheng, Jiayi Xin et al.EMNLP 2024 · 4 citations
- Evolution-Inspired Loss Functions for Protein Representation LearningChengyue Gong, Adam R. Klivans, James Loy, Tianlong Chen et al.ICML 2024 · 10 citations
