Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
INT2 Quantization on OPT-2.7B
Loading...
6.43
Memory Footprint (GB)
OPTQ
5.5756
11.3428
17.11
22.8772
Feb 14, 2024
Memory Footprint (GB)
Updated 4d ago
Evaluation Results
Method
Method
Links
Memory Footprint (GB)
OPTQ
Target=layer-wise reco...
2024.02
6.43
Z-FOLD
Target=layer-wise reco...
2024.02
6.43
OPTQ
Target=layer-wise reco...
2024.02
6.43
Z-FOLD
Target=layer-wise reco...
2024.02
6.43
aespa
Target=attention-wise...
2024.02
6.84
aespa
Target=attention-wise...
2024.02
6.84
OmniQuant
Target=attention-wise...
2024.02
7.09
OmniQuant
Target=attention-wise...
2024.02
7.09
AffineQuant
Target=attention-wise...
2024.02
12.25
AffineQuant
Target=attention-wise...
2024.02
12.25
BRECQ
Target=attention-wise...
2024.02
27.79
BRECQ
Target=attention-wise...
2024.02
27.79
Feedback
Search any
task
Search any
task
