Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Text Generation on XSUM (test)
Loading...
30.4
Throughput (tokens/s)
H2O
-0.9768
7.1691
15.315
23.4609
Jun 24, 2023
Throughput (tokens/s)
Updated 4d ago
Evaluation Results
Method
Method
Links
Throughput (tokens/s)
H2O
Model size=6.7B, Batch...
2023.06
30.4
Accelerate
Model size=6.7B, Batch...
2023.06
11.98
FlexGen
Model size=6.7B, Batch...
2023.06
10.8
H2O
Model size=30B, Batch...
2023.06
6.7
DeepSpeed
Model size=6.7B, Batch...
2023.06
3.52
FlexGen
Model size=30B, Batch...
2023.06
3.29
DeepSpeed
Model size=30B, Batch...
2023.06
0.31
Accelerate
Model size=30B, Batch...
2023.06
0.23
Feedback
Search any
task
Search any
task