Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
LLM Inference on Merge dataset
Loading...
54.3
SLO Attainment
AugServe
7.916
19.958
32
44.042
Dec 3, 2025
SLO Attainment
Updated 1mo ago
Evaluation Results
Method
Method
Links
SLO Attainment
AugServe
Request rate=2.0, Mode...
2025.12
54.3
AugServe
Request rate=3.0, Mode...
2025.12
51.3
AugServe
Request rate=4.0, Mode...
2025.12
45.8
InferCept
Request rate=2.0, Mode...
2025.12
28.3
vLLM
Request rate=2.0, Mode...
2025.12
19.5
InferCept
Request rate=3.0, Mode...
2025.12
19.1
InferCept
Request rate=4.0, Mode...
2025.12
14.2
vLLM
Request rate=3.0, Mode...
2025.12
13.8
vLLM
Request rate=4.0, Mode...
2025.12
9.7
Feedback
Search any
task
Search any
task
