Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Natural Language Understanding on GLUE Dirichlet label skew α=0.1
Loading...
72.89
MNLI-m Accuracy
GLoRA
52.9948
58.1599
63.325
68.4901
May 7, 2026
MNLI-m Accuracy
MNLI-mm Accuracy
SST-2 Accuracy
QQP Accuracy
QNLI Accuracy
Average GLUE Accuracy
Updated 23d ago
Evaluation Results
Method
Method
Links
MNLI-m Accuracy
MNLI-mm Accuracy
SST-2 Accuracy
QQP Accuracy
QNLI Accuracy
Average GLUE Accuracy
GLoRA
LoRA rank=8, Local bat...
2026.05
72.89
72.66
94.49
85.07
84.42
81.91
FedEx-LoRA
LoRA rank=8, Local bat...
2026.05
71.95
71.97
95.27
84.27
84.17
81.33
FedIT
LoRA rank=8, Local bat...
2026.05
71.74
71.68
93.69
83.98
83.91
81
FFA-LoRA
LoRA rank=8, Local bat...
2026.05
67.81
69.27
93.92
82.31
81.95
79.05
FedSA-LoRA
LoRA rank=8, Local bat...
2026.05
53.76
53.11
75
63.18
52.37
59.48
Feedback
Search any
task
Search any
task