INT2 Quantization on LLaMA-30B
18.59Memory Footprint (GB)
OPTQ
Updated 4d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2024.02 | 18.59 | |
2024.02 | 18.59 | |
2024.02 | 18.59 | |
2024.02 | 18.59 | |
2024.02 | 24.53 | |
2024.02 | 24.53 | |
2024.02 | 38.59 | |
2024.02 | 38.59 | |
2024.02 | 43 | |
2024.02 | 43 |
OPTQ
| Method | Links | |
|---|---|---|
2024.02 | 18.59 | |
2024.02 | 18.59 | |
2024.02 | 18.59 | |
2024.02 | 18.59 | |
2024.02 | 24.53 | |
2024.02 | 24.53 | |
2024.02 | 38.59 | |
2024.02 | 38.59 | |
2024.02 | 43 | |
2024.02 | 43 |