Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Latency Profiling on Nemotron-H-8B
Loading...
6.8
TPOT
UniQL
6.096
10.848
15.6
20.352
Dec 3, 2025
TPOT
TTLT
Updated 1mo ago
Evaluation Results
Method
Method
Links
TPOT
TTLT
UniQL
W-bit=4, Prun. p%=35%
2025.12
6.8
6,955.6
UniQL
W-bit=4, Prun. p%=0%
2025.12
8.2
9,095.7
FP16
W-bit=16, Prun. p%=0%
2025.12
24.4
25,889.4
Feedback
Search any
task
Search any
task
