V100
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Inference Efficiency | 1x V100 (16GB) (synthetic) | Throughput (tokens/s)28,298 | 8 |
Showing 1 of 1 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Inference Efficiency | 1x V100 (16GB) (synthetic) | Throughput (tokens/s)28,298 | 8 |