Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Natural Language Understanding on GLUE Dirichlet label skew α=0.5 (Dir(0.5))
Loading...
85.71
MNLI-m Accuracy
GLoRA
82.3508
83.2229
84.095
84.9671
May 7, 2026
MNLI-m Accuracy
MNLI-mm Accuracy
SST-2 Accuracy
QQP Accuracy
QNLI Accuracy
Average Accuracy (Dir 0.5)
Updated 23d ago
Evaluation Results
Method
Method
Links
MNLI-m Accuracy
MNLI-mm Accuracy
SST-2 Accuracy
QQP Accuracy
QNLI Accuracy
Average Accuracy (Dir 0.5)
GLoRA
LoRA rank=8, Local bat...
2026.05
85.71
85.73
96.33
87.21
91.82
89.36
FedIT
LoRA rank=8, Local bat...
2026.05
85.55
85.34
94.96
86.28
89.95
88.42
FedEx-LoRA
LoRA rank=8, Local bat...
2026.05
84.66
84.64
95.64
86.28
90.94
88.43
FedSA-LoRA
LoRA rank=8, Local bat...
2026.05
84.6
85.31
93.37
85.8
90.14
87.84
FFA-LoRA
LoRA rank=8, Local bat...
2026.05
82.48
83.12
95.18
83.42
89.07
86.65
Feedback
Search any
task
Search any
task