Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
LLM Inference on ToolBench dataset
Loading...
100
SLO Attainment
AugServe
5.672
30.161
54.65
79.139
Dec 3, 2025
SLO Attainment
Updated 1mo ago
Evaluation Results
Method
Method
Links
SLO Attainment
AugServe
Request rate=4.0, Mode...
2025.12
100
vLLM
Request rate=4.0, Mode...
2025.12
98.4
AugServe
Request rate=5.0, Mode...
2025.12
63.8
AugServe
Request rate=6.0, Mode...
2025.12
50.1
InferCept
Request rate=4.0, Mode...
2025.12
28.3
vLLM
Request rate=5.0, Mode...
2025.12
22.7
vLLM
Request rate=6.0, Mode...
2025.12
17.8
InferCept
Request rate=5.0, Mode...
2025.12
14
InferCept
Request rate=6.0, Mode...
2025.12
9.3
Feedback
Search any
task
Search any
task
