Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
System Throughput for Knowledge Retrieval on HotpotQA
Loading...
93
LLM Throughput (token/s)
FlashEvolve
10.84
32.17
53.5
74.83
May 8, 2026
LLM Throughput (token/s)
Proposal Throughput (proposal/min)
Updated 22d ago
Evaluation Results
Method
Method
Links
LLM Throughput (token/s)
Proposal Throughput (proposal/min)
FlashEvolve
Deployment=vLLM, Model...
2026.05
93
8.8
Combee
Deployment=vLLM, Model...
2026.05
44
4.5
Combee
Deployment=vLLM, Model...
2026.05
38
2.7
FlashEvolve
Deployment=API, Model=...
2026.05
32
8
GEPA
Deployment=vLLM, Model...
2026.05
30
4.6
Combee
Deployment=API, Model=...
2026.05
23
1.2
Combee
Deployment=API, Model=...
2026.05
18
1.4
GEPA
Deployment=API, Model=...
2026.05
14
2.4
Feedback
Search any
task
Search any
task