Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Decoding Throughput on Llama 3.1 8B

225.01Throughput (TOK/s)

LAQuant

33.088482.9142132.74182.5658May 9, 2026
Updated 22d ago

Evaluation Results

MethodLinks
2026.05
225.015.56
2026.05
198.134.9
2026.05
99.742.46
2026.05
94.352.33
2026.05
40.47-