GPTQ-INT4
| Method | Links | |||
|---|---|---|---|---|
2025.09 | 4.12 | 0.597 | 0.488 | |
2025.09 | 4.12 | 0.589 | 0.481 | |
2025.09 | 4.57 | 0.584 | 0.478 | |
2025.09 | 4.57 | 0.607 | 0.497 | |
2025.09 | 4.57 | 0.542 | 0.444 | |
2025.09 | 4.57 | 0.403 | 0.331 | |
2025.09 | 4.75 | 0.367 | 0.304 | |
2025.09 | 4.75 | 0.366 | 0.304 | |
2025.09 | 5.02 | 0.679 | 0.56 | |
2025.09 | 5.02 | 0.601 | 0.497 | |
2025.09 | 5.34 | 0.374 | 0.323 | |
2025.09 | 5.34 | 0.362 | 0.313 | |
2025.09 | 9.75 | 0.58 | 0.677 | |
2025.09 | 9.84 | 0.358 | 0.572 | |
2025.09 | 10.25 | 0.598 | 0.718 | |
2025.09 | 10.25 | 0.526 | 0.68 | |
2025.09 | 10.73 | 0.579 | 0.739 | |
2025.09 | 10.84 | 0.384 | 0.657 |