Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Question Answering on PIQA (Accuracy and Normalized Accuracy)
Loading...
73.61
Normalized Accuracy
Softmax
66.2052
68.1276
70.05
71.9724
Apr 29, 2025
Normalized Accuracy
Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Normalized Accuracy
Accuracy
Softmax
Model Scale=1.8B
2025.04
73.61
73.78
Softmax
Quantization=2-bit
2025.04
73.45
73.78
Softmax
Quantization=3-bit
2025.04
73.45
73.78
Softpick
Model Scale=1.8B
2025.04
70.89
71.27
Softpick
Quantization=2-bit
2025.04
70.89
71.38
Softpick
Quantization=3-bit
2025.04
70.89
71.38
Softmax
Model Scale=340M
2025.04
66.59
66.97
Softpick
Model Scale=340M
2025.04
66.49
66.59
Feedback
Search any
task
Search any
task
