Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
LLM Decoding on Llama-3-8B
Loading...
0.5172
Decode Time per Step
Pre3
0.50058
0.612765
0.72495
0.837135
Jun 4, 2025
Decode Time per Step
Updated 1mo ago
Evaluation Results
Method
Method
Links
Decode Time per Step
Pre3
Batchsize=1
2025.06
0.5172
XGrammar
Batchsize=1
2025.06
0.5531
Pre3
Batchsize=4
2025.06
0.6537
XGrammar
Batchsize=4
2025.06
0.9327
Feedback
Search any
task
Search any
task
