Generation throughput on Synthetic Generation Workload 512 prompt + 1024 generation tokens
52.1Throughput (tokens/s)
H2O
Updated 3d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2023.06 | 52.1 | |
2023.06 | 16.9 | |
2023.06 | 13.82 | |
2023.06 | 10.1 | |
2023.06 | 7.1 | |
2023.06 | 5.6 | |
2023.06 | 0.6 | |
2023.06 | 0.6 |