Flexible Kernels for Protein Property Prediction
About
Despite its importance to applications in protein design, predicting protein properties like binding affinity and thermostability from sparse experimental data remains a significant challenge. Accordingly, we introduce a class of sequence kernels that exploit evolutionary substitution matrices as well as local linearity and demonstrate that the resulting Gaussian processes provide data-efficient models of protein property landscapes, frequently outperforming alternatives that rely on foundation model embeddings. Furthermore--by learning what are in effect structure-aware substitution matrices--we show that our kernels can readily incorporate structural information from foundation models. We demonstrate that these structure-conditioned kernels are well suited to multi-task learning across multiple protein property landscapes and can decisively outperform local supervised learning methods.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Protein property prediction | 21 protein property datasets 48 data points (Cross-validation) | Spearman Correlation2.08 | 40 | |
| Protein property prediction | 21 protein landscapes Unseen mutations 96 data points | Spearman Correlation3.24 | 31 | |
| Protein property prediction | 21 protein landscapes 1536 train points (cross-val) | Spearman Correlation0.867 | 22 | |
| Protein property prediction | 21 protein landscapes 128 training points (extrapolation) | Spearman Correlation0.669 | 22 | |
| Protein property prediction | 21 protein landscapes Extrapolation 512 training points | Spearman Correlation0.759 | 22 | |
| Protein property prediction | 21 protein property datasets 128 data points (Extrapolation) | Spearman Correlation2.86 | 18 | |
| Protein property prediction | 21 protein property datasets 512 data points (Extrapolation) | Spearman Correlation2.62 | 18 | |
| Protein property prediction | Protein Property Prediction multi-task experiment 50 training points (test) | Spearman Corr0.8 | 14 | |
| Protein property prediction | Protein Property Prediction multi-task experiment 150 train points (test) | Spearman Correlation0.852 | 14 | |
| Protein property prediction | Protein Property Prediction multi-task experiment 700 training points (test) | Spearman Correlation0.911 | 14 |