Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
LLM Decoding on Llama-3-8B
Loading...
0.5172
Decode Time per Step
Pre3
0.50058
0.612765
0.72495
0.837135
Jun 4, 2025
Decode Time per Step
Updated 4d ago
Evaluation Results
Method
Method
Links
Decode Time per Step
Pre3
Batchsize=1
2025.06
0.5172
XGrammar
Batchsize=1
2025.06
0.5531
Pre3
Batchsize=4
2025.06
0.6537
XGrammar
Batchsize=4
2025.06
0.9327
Feedback
Search any
task
Search any
task
