Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Instruction Following Speed Metrics on MT-Bench
Loading...
47.1
Throughput (TPS)
MoE-SpAc
-1.0312
11.4644
23.96
36.4556
Feb 12, 2026
Feb 27, 2026
Mar 15, 2026
Mar 30, 2026
Apr 15, 2026
Apr 30, 2026
May 16, 2026
Throughput (TPS)
Latency
Updated 15d ago
Evaluation Results
Method
Method
Links
Throughput (TPS)
Latency
MoE-SpAc
Base Model=DeepSeek-V2...
2026.02
47.1
12.66
llama.cpp-w/ SD
Base Model=DeepSeek-V2...
2026.02
30.78
21.83
HybriMoE
Base Model=DeepSeek-V2...
2026.02
18.43
33.32
Lever
Target Model=Qwen3-8B,...
2026.05
1.516
-
EdgeLLM
Target Model=Qwen3-8B,...
2026.05
1.283
-
Lever
Target Model=Qwen3-8B,...
2026.05
1.11
-
Chain-SD
Target Model=Qwen3-8B,...
2026.05
1.108
-
EdgeLLM
Target Model=Qwen3-8B,...
2026.05
0.89
-
Chain-SD
Target Model=Qwen3-8B,...
2026.05
0.82
-
Feedback
Search any
task
Search any
task