Our new X account is live! Follow @wizwand_team for updates
Search any
task
Feedback
Search any
task
SOTA LLM Serving benchmarks and papers with code | Wizwand
Our new X account is live! Follow @wizwand_team for updates
Home
/
Tasks
LLM Serving
Benchmarks
Dataset Name
SOTA Method
Dataset Name
SOTA Method
Metric
Trend
Results
Last Updated
ToolBench
AugServe
Effective Throughput (req/s)
1.11
9
4d ago
Merge dataset
AugServe
Effective Throughput (req/s)
0.6
9
4d ago
LLaMA-2 70B chatbot workload
GPU-Only
TTFT (ms)
45.2
4
4d ago
Showing 3 of 3 rows
25 / page
50 / page
100 / page
1
Search any
task
Search any
task
