| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| ShareGPT | TIE | Average PTLA (s/token)0.36 | 36 | 2mo ago | |
| Alpaca | TIE | Average PTLA (s/token)0.3 | 28 | 2mo ago | |
| LMSYS-Chat-1M | TIE | Average PTLA (s/token)0.47 | 28 | 2mo ago | |
| LLaMA 2 chatbot workload 70B | GPU-Only | GPU Power (W)315 | 2 | 3mo ago |