Generation throughput on Synthetic Generation Workload 512 prompt + 512 generation tokens
51.7Throughput (tokens/s)
H2O
Updated 3d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2023.06 | 51.7 | |
2023.06 | 18.83 | |
2023.06 | 16.8 | |
2023.06 | 15.5 | |
2023.06 | 9.6 | |
2023.06 | 8.5 | |
2023.06 | 0.6 | |
2023.06 | 0.6 |