Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Language Modeling on Pile uncopyrighted (test)
Loading...
3.608
Worst Log-Perplexity
FGDRO-KL-Adam
3.42652
4.65151
5.8765
7.10149
Oct 8, 2024
Worst Log-Perplexity
Average Log-Perplexity
Updated 4d ago
Evaluation Results
Method
Method
Links
Worst Log-Perplexity
Average Log-Perplexity
FGDRO-KL-Adam
Model=GPT2, Local iter...
2024.10
3.608
2.653
FedAdam
Model=GPT2, Local iter...
2024.10
7.242
6.479
FGDRO-KL
Model=GPT2, Local iter...
2024.10
7.932
6.664
SCAFFOLD
Model=GPT2, Local iter...
2024.10
7.975
6.901
DRFA
Model=GPT2, Local iter...
2024.10
8.014
6.702
DR-DSGD
Model=GPT2, Local iter...
2024.10
8.023
6.693
FedProx
Model=GPT2, Local iter...
2024.10
8.079
6.724
FedAvg
Model=GPT2, Local iter...
2024.10
8.085
6.785
FGDRO-CVaR
Model=GPT2, Local iter...
2024.10
8.145
6.907
Feedback
Search any
task
Search any
task