Output Equivalence on Qwen3
65.6Exact Match
vLLM + Spec
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2025.10 | 65.6 | 78.5 | |
2025.10 | 50.6 | 69.5 | |
2025.10 | 47.7 | 65.4 | |
2025.10 | 0.95 | 0.971 | |
2025.10 | 0.946 | 0.972 | |
2025.10 | 0.946 | 0.969 | |
2025.10 | 0.946 | 0.969 | |
2025.10 | 0.929 | 0.965 | |
2025.10 | 0.923 | 0.957 | |
2025.10 | 0.035 | 0.199 | |
2025.10 | 0.021 | 0.126 | |
2025.10 | 0.002 | 0.022 | |
2025.10 | 0 | 0.006 |