Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Linguistic Acceptability on CoLA (test)
Loading...
86.34
Avg Accuracy
MAS
78.28
80.3725
82.465
84.5575
Nov 16, 2020
Avg Accuracy
Max Accuracy
MCC
Updated 4d ago
Evaluation Results
Method
Method
Links
Avg Accuracy
Max Accuracy
MCC
MAS
lambda_a=0.3, lambda_s...
2020.11
86.34
86.91
-
MAS
lambda_a=0.4, lambda_s...
2020.11
86.18
87.66
-
MAS
lambda_a=0.5, lambda_s...
2020.11
85.92
86.72
-
MAS
lambda_a=0.6, lambda_s...
2020.11
85.45
86.34
-
MAS
lambda_a=0.7, lambda_s...
2020.11
84.66
85.78
-
SGD
lambda_a=0, lambda_s=1
2020.11
81.48
81.78
-
Adam
lambda_a=1, lambda_s=0
2020.11
79.85
83.3
-
AdamW
2020.11
78.59
85.96
-
Majority
Backbone=RoBERTa-LARGE...
2023.05
-
-
0
Prompt-based FT (hard) + PCP
Backbone=RoBERTa-LARGE...
2023.05
-
-
56
Prompt-based FT (soft) + PCP
Backbone=RoBERTa-LARGE...
2023.05
-
-
21.5
Feedback
Search any
task
Search any
task
