Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Latency Profiling on Qwen 7B Nano 8G 2.5 (inference)
Loading...
57.7
TPOT (ms)
UniQL
54.664
75.157
95.65
116.143
Dec 3, 2025
TPOT (ms)
TTLT (ms)
Updated 1mo ago
Evaluation Results
Method
Method
Links
TPOT (ms)
TTLT (ms)
UniQL
W-bit=4, Prun. p%=35%
2025.12
57.7
28,185.8
UniQL
W-bit=4, Prun. p%=0%
2025.12
77.2
39,795.3
TAO-HQQ
W-bit=4*, Prun. p%=0%
2025.12
133.6
80,770.2
Feedback
Search any
task
Search any
task
