Share your thoughts, 1 month free Claude Pro on us
See more
Feedback
Search any
task
Search any
task
SOTA End-to-end decode throughput benchmarks and papers with code | Wizwand
Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Tasks
End-to-end decode throughput
Benchmarks
Dataset Name
SOTA Method
Dataset Name
SOTA Method
Metric
Trend
Results
Last Updated
context length 128K
Llama-3.1-8B
Throughput (tok/s)
108
6
14d ago
Context Length 32K
Llama-3.1-8B
Decode Throughput (tok/s)
183
6
14d ago
8K Context Length
Llama-3.1-8B
Throughput (tok/s)
268.5
6
14d ago
Showing 3 of 3 rows
25 / page
50 / page
100 / page
1
Search any
task
Search any
task
