Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
LLM Generation on Synthetic
Loading...
50.4
Latency (s)
H2O (20%)
43.848
88.074
132.3
176.526
Jun 24, 2023
Latency (s)
Throughput (token/s)
Updated 4d ago
Evaluation Results
Method
Method
Links
Latency (s)
Throughput (token/s)
H2O (20%)
Sequence length=7000+1...
2023.06
50.4
-
H2O (20%)
Sequence length=2048+2...
2023.06
53.5
918.9
FlexGen
Sequence length=7000+1...
2023.06
57
-
FlexGen
Sequence length=2048+2...
2023.06
99.5
494.1
H2O (20%)
Sequence length=5000+5...
2023.06
155.4
-
FlexGen
Sequence length=5000+5...
2023.06
214.2
-
H2O (20%)
Sequence length=2048+2...
2023.06
-
1,161
Feedback
Search any
task
Search any
task