Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Decoding Throughput on Qwen3-4B
Loading...
231.3
Throughput (tokens/sec)
LAQuant
61.052
105.251
149.45
193.649
May 9, 2026
Throughput (tokens/sec)
Relative Speedup
Updated 22d ago
Evaluation Results
Method
Method
Links
Throughput (tokens/sec)
Relative Speedup
LAQuant
Bits=3, Batch size=1,...
2026.05
231.3
3.42
ParoQuant
Bits=3, Batch size=1,...
2026.05
203.5
3.01
LAQuant
Bits=4, Batch size=1,...
2026.05
135.1
2
ParoQuant
Bits=4, Batch size=1,...
2026.05
124.5
1.84
FP16
Bits=16, Batch size=1,...
2026.05
67.6
-
Feedback
Search any
task
Search any
task
