Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
LLM Serving on Real-world trace (ShareGPT and BurstGPT)
Loading...
91.13
SLO Attainment
DiLaServe
59.774
67.9145
76.055
84.1955
Jun 27, 2026
SLO Attainment
Overall Score
Average Latency (Overall)
Average Latency (Low-load)
Average Latency (High-load)
Updated 25d ago
Evaluation Results
Method
Method
Links
SLO Attainment
Overall Score
Average Latency (Overall)
Average Latency (Low-load)
Average Latency (High-load)
DiLaServe
Configuration=Dynamic...
2026.06
91.13
6.8
5.75
2.26
6.33
INFaaS
Configuration=Fixed 16...
2026.06
70.03
6.89
8.8
2.71
9.34
Llumnix
Configuration=Fixed 16...
2026.06
60.98
6.89
10.64
3.23
11.3
Feedback
Search any
task
Search any
task
