Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Text Generation on HumanEval (Throughput)
Loading...
188.12
Throughput (tokens/s)
EVICT
57.9536
91.7468
125.54
159.3332
May 1, 2026
Throughput (tokens/s)
Speedup
Updated 1mo ago
Evaluation Results
Method
Method
Links
Throughput (tokens/s)
Speedup
EVICT
Temperature=0, Backbon...
2026.05
188.12
-
EVICT
Temperature=1, Backbon...
2026.05
183.21
-
EAGLE-3
Temperature=0, Backbon...
2026.05
144.34
-
EAGLE-3
Temperature=1, Backbon...
2026.05
141.31
-
DDD
Temperature=0, Backbon...
2026.05
137.64
-
DDD
Temperature=1, Backbon...
2026.05
135.7
-
Vanilla
Temperature=0, Backbon...
2026.05
80.61
-
Vanilla
Temperature=1, Backbon...
2026.05
76.73
-
Lookahead
Temperature=0, Backbon...
2026.05
63.32
-
Lookahead
Temperature=1, Backbon...
2026.05
62.96
-
Feedback
Search any
task
Search any
task
