Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Latency Measurement on LLaMA-7B linear layers (4096 × 11008)
Loading...
0.0514
Latency (ms)
MBOK
-0.072039
0.760903
1.593845
2.426787
May 28, 2025
Latency (ms)
Speed-up
Updated 1mo ago
Evaluation Results
Method
Method
Links
Latency (ms)
Speed-up
MBOK
WEIGHT SIZE=4096 × 110...
2025.05
0.0514
5.44
FP16
WEIGHT SIZE=4096 × 110...
2025.05
0.2794
-
QUIP#
WEIGHT SIZE=4096 × 110...
2025.05
0.5553
0.5
QTIP
WEIGHT SIZE=4096 × 110...
2025.05
3.1363
0.09
Feedback
Search any
task
Search any
task