Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Next-token prediction on WikiText-2 BPE-2048 (val)
Loading...
29.17
Tail Accuracy
FedAvg-fa1
14.9012
18.6056
22.31
26.0144
Jun 30, 2026
Tail Accuracy
Tail Perplexity
Updated 23d ago
Evaluation Results
Method
Method
Links
Tail Accuracy
Tail Perplexity
FedAvg-fa1
Payload=491 GB
2026.06
29.17
80.9
TallyTrain+fa200
Payload=2.60 GB
2026.06
22.97
403.3
FedAvg-fa200
Payload=2.45 GB
2026.06
21.52
408.3
FedMD (pure)
Payload=1,268 GB
2026.06
15.78
3,622
TallyTrain (pure)
Payload=0.31 GB
2026.06
15.45
10,087
Feedback
Search any
task
Search any
task