Regression on Beta-lactamase PEER

0.81Spearman Correlation

ESM2-150M Masked-pos (run 1)

Updated 23d ago

Evaluation Results

Method
ESM2-150M Masked-pos (run 1) 2026.05	0.81	-
ESM2-150M Masked-pos (run 2) 2026.05	0.804	-
ProtSent 2026.05	0.793	18.5
ESM2-150M Baseline 2026.05	0.749	-
AMPLIFY-120M Masked-pos 2026.05	0.748	-
AMPLIFY-120M MLM-only 2026.05	0.746	-
AMPLIFY-120M All-pos MLM+JEPA 2026.05	0.746	-
ESM2-150M All-pos MLM+JEPA 2026.05	0.74	-
ESM2-150M EMA (4h) EMA 2026.05	0.737	-
ProtSent 2026.05	0.733	0.1
ESM-2 2026.05	0.732	-
AMPLIFY-120M Baseline 2026.05	0.718	-
ESM2-35M Masked-pos (AdamW) 2026.05	0.712	-
MLM+JEPA @90k 2026.05	0.703	-
ESM2-35M Masked-pos (SGDm) 2026.05	0.685	-
ESM2-150M MLM-only 2026.05	0.682	-
ProteinBERT2-150M masked-pos 2026.05	0.671	-
ESM-2 2026.05	0.67	-
ESM2-35M Baseline 2026.05	0.666	-
ESM2-35M All-pos MLM+JEPA 2026.05	0.659	-
ESM2-35M MLM-only 2026.05	0.655	-
ProteinBERT2-35M Masked-pos 2026.05	0.636	-
Rand-Init-35M Masked-pos 2026.05	0.635	-
Rand-Init-35M MLM-only 2026.05	0.593	-
AMPLIFY-120M JEPA-only 2026.05	0.564	-
ProteinBERT2-35M All-pos MLM+JEPA 2026.05	0.559	-
JEPA-only @90k 2026.05	0.544	-
ESM2-150M rand-init MLM-only 2026.05	0.471	-
Rand-Init-35M JEPA-only 2026.05	0.467	-
Rand-Init-35M All-pos MLM+JEPA 2026.05	0.452	-
ProteinBERT2-35M MLM-only 2026.05	0.438	-
ESM2-150M JEPA-only 2026.05	0.401	-
ProteinBERT2-35M Baseline 2026.05	0.397	-
ProteinBERT2-35M JEPA-only 2026.05	0.334	-
Rand-Init-35M Baseline 2026.05	0.331	-
ESM2-35M JEPA-only 2026.05	0.296	-