Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Next-word prediction on Article-Title benchmark
Loading...
14.32
Mean Accuracy
HASA
12.6768
13.1034
13.53
13.9566
May 30, 2026
Mean Accuracy
Worst-Client Accuracy
P10 Accuracy
Avg PPL
Weighted Ratio
Updated 1mo ago
Evaluation Results
Method
Method
Links
Mean Accuracy
Worst-Client Accuracy
P10 Accuracy
Avg PPL
Weighted Ratio
HASA
Policy=HASA, Budget (B...
2026.05
14.32
11.99
12.52
513.3
49.6
Uniform
Policy=Uniform, Budget...
2026.05
13.82
11.47
12.04
520.8
50
Mixed
Policy=Mixed, gamma=0....
2026.05
13.6
10.56
11.32
559.5
50
FedAvg-Full (ref.)
Policy=FedAvg-Full, Bu...
2026.05
13.03
10.96
11.51
576.8
100
Size-only
Policy=Size-only, Budg...
2026.05
12.74
10.7
10.95
540.7
50
Feedback
Search any
task
Search any
task