Generation throughput on Synthetic Generation Workload 512 prompt + 32 generation tokens
35.1Throughput (tokens/s)
H2O
Updated 3d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2023.06 | 35.1 | |
2023.06 | 20.4 | |
2023.06 | 20.2 | |
2023.06 | 12.7 | |
2023.06 | 10.2 | |
2023.06 | 8.1 | |
2023.06 | 0.6 | |
2023.06 | 0.6 |