| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| ShareGPT | TIE | Average PTLA (s/token)0.36 | 36 | 17d ago | |
| Alpaca | TIE | Average PTLA (s/token)0.3 | 28 | 17d ago | |
| LMSYS-Chat-1M | TIE | Average PTLA (s/token)0.47 | 28 | 17d ago | |
| LLaMA 2 chatbot workload 70B | GPU-Only | GPU Power (W)315 | 2 | 1mo ago |