Speculative Decoding on Spec-Bench
195.6MT Score
FR-Spec
Updated 2d ago
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2025.02 | 195.6 | - | 188.14 | 190.27 | 243.36 | 184.85 | - | 201.87 | - | 227.68 | 183.19 | 2.27 | |
2025.02 | 194.02 | - | 182.26 | 188.6 | 233.69 | 178.22 | - | 196.69 | - | 223.32 | 176.7 | 2.21 | |
2025.02 | 192.85 | - | 183.86 | 183.17 | 231.99 | 178.53 | - | 196.86 | - | 224.52 | 183.11 | 2.21 | |
2025.02 | 185.78 | - | 170.97 | 180.4 | 218.57 | 167.61 | - | 185.98 | - | 210.66 | 167.85 | 2.09 | |
2025.02 | 176.79 | - | 167.12 | 166.6 | 209.88 | 168.05 | - | 180.99 | - | 203.41 | 175.11 | 2.03 | |
2025.02 | 90.94 | - | 86.63 | 91.05 | 91.16 | 83.43 | - | 89.11 | - | 90.43 | 90.1 | 1 | |
2026.02 | 18.53 | 18.06 | 16.19 | 17.42 | 21.45 | 15.48 | - | - | 17.95 | - | - | - | |
2026.02 | 18.18 | 17.62 | 16.57 | 17.41 | 20.81 | 15.8 | - | - | 17.79 | - | - | - | |
2026.02 | 17.77 | 17.95 | 16.42 | 17.1 | 20.46 | 15.6 | - | - | 17.58 | - | - | - | |
2026.02 | 17.55 | 17.85 | 16.1 | 17.34 | 20.21 | 15.69 | - | - | 17.47 | - | - | - | |
2026.02 | 9.04 | 9.31 | 8.63 | 9.32 | 9.29 | 8.32 | - | - | 8.99 | - | - | - | |
2025.12 | 4.62 | 3.12 | 4.18 | 3.38 | 4.16 | 3.95 | - | - | 3.9 | - | - | - | |
2025.12 | 4.54 | 3.19 | 3.81 | 3.41 | 4.38 | 3.8 | - | - | 3.86 | - | - | - | |
2025.12 | 4.52 | 3.73 | 4.54 | 3.42 | 4.62 | 4.29 | - | - | 4.18 | - | - | - | |
2025.12 | 3.9 | 2.88 | 2.95 | 3.21 | 3.9 | 3.37 | - | - | 3.37 | - | - | - | |
2026.02 | 3.82 | - | 4.49 | 4.92 | 6.28 | 5.26 | - | - | 5.01 | 5.3 | - | - | |
2026.02 | 3.8 | - | 4.52 | 4.52 | 5.77 | 4.9 | - | - | 4.69 | 4.62 | - | - | |
2026.02 | 3.69 | - | 4.28 | 4.72 | 6.04 | 5.13 | - | - | 4.84 | 5.17 | - | - | |
2025.12 | 3.66 | 2.74 | 3.15 | 2.81 | 3.57 | 3.21 | - | - | 3.19 | - | - | - | |
2026.02 | 3.6 | - | 4.21 | 4.8 | 5.94 | 5.04 | - | - | 4.78 | 5.11 | - | - | |
2026.02 | 3.59 | - | 4.63 | 5.09 | 6.05 | 5.45 | - | - | 5.01 | 5.26 | - | - | |
2026.02 | 3.52 | - | 4.59 | 4.66 | 5.61 | 4.79 | - | - | 4.62 | 4.57 | - | - | |
2026.02 | 3.43 | - | 4.92 | 4.13 | 5.14 | 4.55 | - | - | 4.53 | 4.98 | - | - | |
2026.02 | 3.43 | - | 4.35 | 5.05 | 5.86 | 5.04 | - | - | 4.82 | 5.2 | - | - | |
2026.02 | 3.41 | - | 4.77 | 4.04 | 4.87 | 4.32 | - | - | 4.33 | 4.56 | - | - | |
2026.02 | 3.37 | - | 4.31 | 4.94 | 5.79 | 4.94 | - | - | 4.73 | 5.02 | - | - | |
2026.02 | 3.34 | - | 3.86 | 4.46 | 5.28 | 4.52 | - | - | 4.33 | 4.52 | - | - | |
2024.11 | 3.27 | 2.12 | 2.89 | 2.34 | 3.12 | 2.54 | 4.51 | 57.88 | 2.72 | - | - | - | |
2026.02 | 3.24 | - | 4.64 | 4.12 | 5.08 | 4.39 | - | - | 4.38 | 4.83 | - | - | |
2026.02 | 3.22 | - | 4.55 | 4 | 4.88 | 4.39 | - | - | 4.31 | 4.8 | - | - | |
2024.11 | 3.19 | 1.97 | 2.86 | 2.28 | 2.84 | 2.32 | 4.52 | 129.36 | 2.58 | - | - | - | |
2024.11 | 3.1 | 2.15 | 2.58 | 2.38 | 3.19 | 2.33 | 4.42 | 56.06 | 2.63 | - | - | - | |
2025.12 | 2.74 | 2.48 | 2.68 | 2.59 | 3.05 | 2.63 | - | - | 2.7 | - | - | - | |
2025.12 | 2.7 | 2.18 | 2.12 | 2.24 | 2.67 | 2.26 | - | - | 2.36 | - | - | - | |
2024.11 | 2.66 | 1.76 | 2.18 | 2.03 | 2.63 | 1.97 | 4.34 | 110.56 | 2.21 | - | - | - | |
2024.11 | 2.62 | 1.82 | 2.92 | 2.09 | 2.6 | 2.21 | 3.02 | 119.21 | 2.38 | - | - | - | |
2024.11 | 2.36 | 1.8 | 2.63 | 1.83 | 2.49 | 2.22 | 2.91 | 47.27 | 2.22 | - | - | - | |
2025.12 | 2.12 | 1.39 | 2.16 | 1.8 | 1.92 | 2.26 | - | - | 1.94 | - | - | - | |
2024.11 | 2.08 | 1.26 | 2.23 | 1.53 | 2.09 | 1.89 | 2.19 | 39.24 | 1.84 | - | - | - | |
2024.11 | 2.08 | 1.76 | 1.97 | 1.85 | 2.35 | 1.76 | 2.82 | 98.39 | 1.96 | - | - | - | |
2024.11 | 2.03 | 1.84 | 2.07 | 1.83 | 2.42 | 1.84 | 2.81 | 42.74 | 2.01 | - | - | - | |
2025.12 | 1.69 | 1.24 | 1.54 | 1.56 | 1.92 | 1.42 | - | - | 1.56 | - | - | - | |
2025.12 | 1.67 | 1.1 | 2.73 | 1.37 | 1.8 | 1.71 | - | - | 1.73 | - | - | - | |
2024.11 | 1.61 | 1.1 | 2.36 | 1.11 | 1.69 | 1.8 | 1.66 | 33.89 | 1.59 | - | - | - | |
2025.12 | 1 | 1 | 1 | 1 | 1 | 1 | - | - | 1 | - | - | - | |
2026.02 | 1 | - | 1 | 1 | 1 | 1 | - | - | 1 | 1 | - | - | |
2026.02 | 1 | - | 1 | 1 | 1 | 1 | - | - | 1 | 1 | - | - | |
2026.02 | 1 | - | 1 | 1 | 1 | 1 | - | - | 1 | 1 | - | - |