INT2 Quantization on OPT-6.7B
11.68Memory Footprint (GB)
OmniQuant
Updated 4d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2024.02 | 11.68 | |
2024.02 | 11.68 | |
2024.02 | 12.26 | |
2024.02 | 12.26 | |
2024.02 | 13.07 | |
2024.02 | 13.07 | |
2024.02 | 13.07 | |
2024.02 | 13.07 | |
2024.02 | 20.08 | |
2024.02 | 20.08 |