Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Natural Language Generation on MMLU (Subject Performance)
Loading...
28.1
STEM Score
SHE-LoRA
21.236
23.018
24.8
26.582
May 27, 2025
STEM Score
SS Score
Humanities Score
Average Score
Updated 4d ago
Evaluation Results
Method
Method
Links
STEM Score
SS Score
Humanities Score
Average Score
SHE-LoRA
setting=heterogeneous
2025.05
28.1
29.2
26.5
28.2
Flex-LoRA
setting=heterogeneous
2025.05
26.2
27.9
26.6
27.4
HeterLoRA
setting=heterogeneous
2025.05
24.7
25.4
25.8
26
FedSA
rank=8, setting=homoge...
2025.05
21.8
21.4
19.7
20.1
FedIT
rank=8, setting=homoge...
2025.05
21.5
21.3
20.4
21.2
Feedback
Search any
task
Search any
task