Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
INT2 Quantization on OPT-1.3B
Loading...
4.49
Memory Footprint (GB)
OPTQ
4.0056
7.2753
10.545
13.8147
Feb 14, 2024
Memory Footprint (GB)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Memory Footprint (GB)
OPTQ
Target=layer-wise reco...
2024.02
4.49
Z-FOLD
Target=layer-wise reco...
2024.02
4.49
OPTQ
Target=layer-wise reco...
2024.02
4.49
Z-FOLD
Target=layer-wise reco...
2024.02
4.49
aespa
Target=attention-wise...
2024.02
5.47
aespa
Target=attention-wise...
2024.02
5.47
OmniQuant
Target=attention-wise...
2024.02
5.87
OmniQuant
Target=attention-wise...
2024.02
5.87
AffineQuant
Target=attention-wise...
2024.02
9.96
AffineQuant
Target=attention-wise...
2024.02
9.96
BRECQ
Target=attention-wise...
2024.02
16.6
BRECQ
Target=attention-wise...
2024.02
16.6
Feedback
Search any
task
Search any
task
