| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| Llama 2 7B inference v1.0 | QTIP | Decoding Throughput (TOK/s)188 | 6 | 1mo ago | |
| Llama 2 70B v1.0 (inference) | QTIP | Throughput (TOK/s)23.5 | 5 | 1mo ago | |
| GSM8k | AR Throughput (tok/s)88.8 | 2 | 1mo ago | ||
| Alpaca | AR Throughput (tok/s)88.8 | 2 | 1mo ago | ||
| Ultrafeedback | AR Throughput (tok/s)88.8 | 2 | 1mo ago | ||
| HumanEval | AR Throughput (tok/s)88.8 | 2 | 1mo ago |
