Share your thoughts, 1 month free Claude Pro on us
See more
Feedback
Search any
task
Search any
task
SOTA LLM Serving benchmarks and papers with code | Wizwand
Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Tasks
LLM Serving
Benchmarks
Dataset Name
SOTA Method
Dataset Name
SOTA Method
Metric
Trend
Results
Last Updated
ToolBench
AugServe
Effective Throughput (req/s)
1.11
9
1mo ago
Merge dataset
AugServe
Effective Throughput (req/s)
0.6
9
1mo ago
LLaMA-2 70B chatbot workload
GPU-Only
TTFT (ms)
45.2
4
1mo ago
Showing 3 of 3 rows
25 / page
50 / page
100 / page
1
Search any
task
Search any
task
