Spec-Bench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Speculative Decoding | Spec-Bench | MT Score195.6 | 48 | |
| Inference Acceleration | Spec-Bench | MAT Score4.62 | 39 | |
| Language Model Decoding | Spec-Bench | Conv. Acc267.6 | 11 | |
| Speculative Decoding Throughput | Spec-Bench | Throughput (Conv.)519.7 | 10 | |
| Speculative Decoding | Spec-Bench OLMo 2 7B | Conversation Score5.12 | 5 | |
| Speculative Decoding Throughput | Spec-Bench (test) | Throughput (Conv.)- | 0 |
Showing 6 of 6 rows