Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Instruction Following on IFBench (Throughput Metrics)
Loading...
2,688
LLM Throughput (tokens/s)
FlashEvolve
267.92
896.21
1,524.5
2,152.79
May 8, 2026
LLM Throughput (tokens/s)
Proposal Throughput (proposals/s)
Updated 22d ago
Evaluation Results
Method
Method
Links
LLM Throughput (tokens/s)
Proposal Throughput (proposals/s)
FlashEvolve
Deployment=vLLM, Model...
2026.05
2,688
0.1483
GEPA
Deployment=vLLM, Model...
2026.05
963
0.0317
Combee
Deployment=vLLM, Model...
2026.05
900
0.0117
FlashEvolve
Deployment=API, Model=...
2026.05
791
0.1683
Combee
Deployment=vLLM, Model...
2026.05
696
0.02
Combee
Deployment=API, Model=...
2026.05
397
0.0167
Combee
Deployment=API, Model=...
2026.05
389
0.0133
GEPA
Deployment=API, Model=...
2026.05
361
0.0283
Feedback
Search any
task
Search any
task