Share your thoughts, 1 month free Claude Pro on us
See more
Feedback
Search any
task
Search any
task
SOTA Large Language Model Serving benchmarks and papers with code | Wizwand
Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Tasks
Large Language Model Serving
Benchmarks
Dataset Name
SOTA Method
Dataset Name
SOTA Method
Metric
Trend
Results
Last Updated
vLLM serving benchmark 128 prompts, 32 pre-fill tokens, 256 generation tokens
DeInfer
TTFT (ms)
76
9
1mo ago
Showing 1 of 1 rows
25 / page
50 / page
100 / page
1
Search any
task
Search any
task
