Our new X account is live! Follow @wizwand_team for updates
Search any
task
Feedback
Search any
task
SOTA Decoding Throughput benchmarks and papers with code | Wizwand
Our new X account is live! Follow @wizwand_team for updates
Home
/
Tasks
Decoding Throughput
Benchmarks
Dataset Name
SOTA Method
Dataset Name
SOTA Method
Metric
Trend
Results
Last Updated
Llama 2 7B inference v1.0
QTIP
Decoding Throughput (TOK/s)
188
6
4d ago
Llama 2 70B v1.0 (inference)
QTIP
Throughput (TOK/s)
23.5
5
4d ago
Showing 2 of 2 rows
25 / page
50 / page
100 / page
1
Search any
task
Search any
task
