Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Linguistic Acceptability on CoLA (OOD)
Loading...
23.06
MCC
DIRECTOR
18.2448
19.4949
20.745
21.9951
Feb 9, 2026
MCC
ECE
NLL
Brier Score
Updated 1mo ago
Evaluation Results
Method
Method
Links
MCC
ECE
NLL
Brier Score
DIRECTOR
base_model=Transformer
2026.02
23.06
28.72
17.18
59.91
DIRECTOR
base_model=KEP-1/5
2026.02
22.1
17.5
9.34
49.92
KEP
config_ratio=5/5
2026.02
21.14
23.27
14.25
55.12
DIRECTOR
base_model=KEP-5/5
2026.02
20.2
17.49
8.61
48.55
KEP
config_ratio=1/5
2026.02
19.44
30.33
19.67
61.97
Transformer
2026.02
18.43
31.99
23.82
65.5
Feedback
Search any
task
Search any
task
