Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LLM Decoding on Llama-2 70B (Throughput)

36.1Throughput (tokens/s)

AWQ

16.8621.85526.8531.845Jun 2, 2026
Updated 1mo ago

Evaluation Results

MethodLinks
2026.06
36.1
2026.06
31.3
2026.06
25.7
2026.06
24.5
2026.06
20.8
2026.06
17.6