Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Decoding Throughput on Qwen3 1.7B
Loading...
316.9
Decoding Throughput (tokens/sec)
LAQuant
131.26
179.455
227.65
275.845
May 9, 2026
Decoding Throughput (tokens/sec)
Speedup Factor
Updated 22d ago
Evaluation Results
Method
Method
Links
Decoding Throughput (tokens/sec)
Speedup Factor
LAQuant
Bits=3, Batch size=1,...
2026.05
316.9
2.29
ParoQuant
Bits=3, Batch size=1,...
2026.05
283.7
2.05
LAQuant
Bits=4, Batch size=1,...
2026.05
227.3
1.64
ParoQuant
Bits=4, Batch size=1,...
2026.05
205.3
1.48
FP16
Bits=16, Batch size=1,...
2026.05
138.4
-
Feedback
Search any
task
Search any
task
