ProteinGym
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Fitness Prediction | ProteinGym (overall) | Spearman Correlation0.519 | 43 | |
| Protein variant effect prediction | ProteinGym substitution benchmark | Average Spearman Correlation0.681 | 20 | |
| Protein fitness prediction | ProteinGym | Average Spearman Correlation0.496 | 19 | |
| Mutation Fitness Prediction | ProteinGym | AUROC89.74 | 16 | |
| Protein Fitness Prediction | ProteinGym (test) | Avg. Spearman Correlation0.5087 | 14 | |
| Supervised protein substitution DMS prediction | ProteinGym Contig | Spearman's rho0.7 | 12 | |
| Mutational effect prediction | ProteinGym DMS 1 and 2 mutation set (2 mutation) | Spearman Correlation0.72 | 12 | |
| Mutational effect prediction | ProteinGym DMS 1 and 2 mutation set (1 mutation) | Spearman Correlation0.904 | 12 | |
| Mutational fitness prediction | ProteinGym 96 DMS assays L <= 200 | Spearman Correlation0.518 | 11 | |
| Mutation Fitness Prediction | ProteinGym substitution benchmark (217 proteins) (fold 4 test) | AUROC89.74 | 9 | |
| Indel variant effect prediction | ProteinGym indel | Average Spearman Correlation0.53 | 7 | |
| Fitness Prediction | ProteinGym | Spearman Correlation (GFP Stability)0.78 | 7 | |
| Supervised protein substitution DMS prediction | ProteinGym (Rand split) | Spearman's rho0.783 | 6 | |
| Mutational effect prediction | ProteinGym DMS >2 mutations set (4 mutation split) | Spearman Correlation0.615 | 6 | |
| Mutational effect prediction | ProteinGym DMS (>2 mutations set) (3 mutation split) | Spearman Correlation0.652 | 6 |
Showing 15 of 15 rows