INT2 Quantization on LLaMA-13B
12.34Memory Cost (GB)
OPTQ
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2024.02 | 12.34 | |
2024.02 | 12.34 | |
2024.02 | 12.34 | |
2024.02 | 12.34 | |
2024.02 | 17.02 | |
2024.02 | 17.02 | |
2024.02 | 27.1 | |
2024.02 | 27.1 | |
2024.02 | 29.27 | |
2024.02 | 29.27 |
OPTQ
| Method | Links | |
|---|---|---|
2024.02 | 12.34 | |
2024.02 | 12.34 | |
2024.02 | 12.34 | |
2024.02 | 12.34 | |
2024.02 | 17.02 | |
2024.02 | 17.02 | |
2024.02 | 27.1 | |
2024.02 | 27.1 | |
2024.02 | 29.27 | |
2024.02 | 29.27 |