SpecBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Speculative Decoding | SpecBench | AVG SR900.7 | 47 | |
| Speculative Decoding | SpecBench v1 (test) | WRIT τ4.9 | 12 | |
| Speculative Decoding | SpecBench Qwen-2-7B-Instruct (test) | Overall Mean Score3.65 | 5 | |
| Speculative Decoding | SpecBench Vicuna-33B v1.3 (test) | MT Score3.52 | 4 | |
| LLM Generation | SpecBench | Tokens/s116.95 | 3 |
Showing 5 of 5 rows