Disorder Prediction on CheZoD

0.702Spearman Correlation

ESM2-35M Masked-pos (AdamW)

Updated 23d ago

Evaluation Results

Method	Links
ESM2-35M Masked-pos (AdamW) 2026.05		0.702
ESM2-35M Baseline 2026.05		0.687
ESM2-150M Baseline 2026.05		0.686
ProteinBERT2-35M Masked-pos 2026.05		0.676
Rand-Init-35M MLM-only 2026.05		0.675
ESM2-150M Masked-pos (run 2) 2026.05		0.673
ESM2-150M EMA (4h) EMA 2026.05		0.673
ProteinBERT2-150M masked-pos 2026.05		0.672
Rand-Init-35M Masked-pos 2026.05		0.671
AMPLIFY-120M Masked-pos 2026.05		0.67
ESM2-35M Masked-pos (SGDm) 2026.05		0.666
MLM+JEPA @90k 2026.05		0.666
ESM2-35M MLM-only 2026.05		0.656
ESM2-150M Masked-pos (run 1) 2026.05		0.654
ESM2-150M MLM-only 2026.05		0.632
AMPLIFY-120M Baseline 2026.05		0.63
AMPLIFY-120M MLM-only 2026.05		0.617
ProteinBERT2-35M All-pos MLM+JEPA 2026.05		0.609
ESM2-150M All-pos MLM+JEPA 2026.05		0.605
AMPLIFY-120M All-pos MLM+JEPA 2026.05		0.6
Rand-Init-35M Baseline 2026.05		0.598
ESM2-150M rand-init MLM-only 2026.05		0.573
JEPA-only @90k 2026.05		0.543
Rand-Init-35M All-pos MLM+JEPA 2026.05		0.521
ESM2-35M All-pos MLM+JEPA 2026.05		0.492
Rand-Init-35M JEPA-only 2026.05		0.484
ProteinBERT2-35M MLM-only 2026.05		0.436
ProteinBERT2-35M Baseline 2026.05		0.405
ESM2-150M JEPA-only 2026.05		0.297
AMPLIFY-120M JEPA-only 2026.05		0.241
ESM2-35M JEPA-only 2026.05		0.161
ProteinBERT2-35M JEPA-only 2026.05		0.053