Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Linguistic Acceptability on CoLA (OOD)
Loading...
23.06
MCC
DIRECTOR
18.2448
19.4949
20.745
21.9951
Feb 9, 2026
MCC
ECE
NLL
Brier Score
Updated 4d ago
Evaluation Results
Method
Method
Links
MCC
ECE
NLL
Brier Score
DIRECTOR
base_model=Transformer
2026.02
23.06
28.72
17.18
59.91
DIRECTOR
base_model=KEP-1/5
2026.02
22.1
17.5
9.34
49.92
KEP
config_ratio=5/5
2026.02
21.14
23.27
14.25
55.12
DIRECTOR
base_model=KEP-5/5
2026.02
20.2
17.49
8.61
48.55
KEP
config_ratio=1/5
2026.02
19.44
30.33
19.67
61.97
Transformer
2026.02
18.43
31.99
23.82
65.5
Feedback
Search any
task
Search any
task
