Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
LLM Inference on Merge dataset
Loading...
54.3
SLO Attainment
AugServe
7.916
19.958
32
44.042
Dec 3, 2025
SLO Attainment
Updated 4d ago
Evaluation Results
Method
Method
Links
SLO Attainment
AugServe
Request rate=2.0, Mode...
2025.12
54.3
AugServe
Request rate=3.0, Mode...
2025.12
51.3
AugServe
Request rate=4.0, Mode...
2025.12
45.8
InferCept
Request rate=2.0, Mode...
2025.12
28.3
vLLM
Request rate=2.0, Mode...
2025.12
19.5
InferCept
Request rate=3.0, Mode...
2025.12
19.1
InferCept
Request rate=4.0, Mode...
2025.12
14.2
vLLM
Request rate=3.0, Mode...
2025.12
13.8
vLLM
Request rate=4.0, Mode...
2025.12
9.7
Feedback
Search any
task
Search any
task
