INT2 Quantization on LLaMA 7B
8.76Memory Cost (GB)
OPTQ
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2024.02 | 8.76 | |
2024.02 | 8.76 | |
2024.02 | 8.76 | |
2024.02 | 8.76 | |
2024.02 | 12.61 | |
2024.02 | 12.61 | |
2024.02 | 21.69 | |
2024.02 | 21.69 | |
2024.02 | 24.28 | |
2024.02 | 24.28 |
OPTQ
| Method | Links | |
|---|---|---|
2024.02 | 8.76 | |
2024.02 | 8.76 | |
2024.02 | 8.76 | |
2024.02 | 8.76 | |
2024.02 | 12.61 | |
2024.02 | 12.61 | |
2024.02 | 21.69 | |
2024.02 | 21.69 | |
2024.02 | 24.28 | |
2024.02 | 24.28 |