Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Common-sense Reasoning on 5 common-sense reasoning tasks (Llama-2-70B)
Loading...
72.41
Average Accuracy
FP16
54.1684
58.9042
63.64
68.3758
Jul 10, 2024
Average Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Average Accuracy
FP16
Bits=16, Group=-, Eval...
2024.07
72.41
QuIP#
Bits=3, Group=-, Evalu...
2024.07
72.13
EfficientQAT
Bits=3, Group=128, Eva...
2024.07
71.76
GPTQ
Bits=3, Group=128, Eva...
2024.07
71.47
AWQ
Bits=3, Group=128, Eva...
2024.07
71.41
AutoRound
Bits=3, Group=128, Eva...
2024.07
71.24
OmniQ
Bits=3, Group=128, Eva...
2024.07
71.07
QuIP#
Bits=2, Group=-, Evalu...
2024.07
70.91
RTN
Bits=3, Group=128, Eva...
2024.07
70.83
AQLM
Bits=2, Group=2x8, Eva...
2024.07
69.85
EfficientQAT
Bits=2, Group=64, Eval...
2024.07
69.48
EfficientQAT
Bits=2, Group=128, Eva...
2024.07
68.93
DB-LLM
Bits=2, Group=64, Eval...
2024.07
68.01
AutoRound
Bits=2, Group=128, Eva...
2024.07
67.7
OmniQ
Bits=2, Group=128, Eva...
2024.07
54.87
Feedback
Search any
task
Search any
task