Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Multi-turn Dialogue Response Generation on MT-bench (test)
Loading...
2.78
Speedup Ratio (γ)
CTC-drafter
0.9288
1.4094
1.89
2.3706
Nov 25, 2024
Speedup Ratio (γ)
Accepted Tokens/Step (β)
Updated 4d ago
Evaluation Results
Method
Method
Links
Speedup Ratio (γ)
Accepted Tokens/Step (β)
CTC-drafter
Base Model=Vicuna-7B
2024.11
2.78
3.56
CTC-drafter
Base Model=Vicuna-13B
2024.11
2.52
3.51
Hydra
Base Model=Vicuna-7B
2024.11
2.36
3.04
CTC-drafter
Base Model=Vicuna-33B
2024.11
2.2
3.53
Hydra
Base Model=Vicuna-13B
2024.11
2.17
3.06
Hydra
Base Model=Vicuna-33B
2024.11
2.15
2.95
Medusa
Base Model=Vicuna-7B
2024.11
2.13
2.58
Medusa
Base Model=Vicuna-13B
2024.11
1.97
2.6
Medusa
Base Model=Vicuna-33B
2024.11
1.93
2.55
Vanilla
Base Model=Vicuna-7B
2024.11
1
1
Vanilla
Base Model=Vicuna-13B
2024.11
1
1
Vanilla
Base Model=Vicuna-33B
2024.11
1
1
Feedback
Search any
task
Search any
task