Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Question Answering on OBQA (acc_norm)
Loading...
41.8
Accuracy (Normalized)
No pruning (Original)
24.328
28.864
33.4
37.936
Mar 25, 2026
Accuracy (Normalized)
Updated 24d ago
Evaluation Results
Method
Method
Links
Accuracy (Normalized)
No pruning (Original)
Backbone=Gemma-2 2B, S...
2026.03
41.8
DIET
Backbone=Gemma-2 2B, S...
2026.03
35.4
Magnitude-Dim
Backbone=Gemma-2 2B, S...
2026.03
31.2
PuDDing
Backbone=Gemma-2 2B, S...
2026.03
30
DIET
Backbone=Gemma-2 2B, S...
2026.03
27.6
SliceGPT
Backbone=Gemma-2 2B, S...
2026.03
27
PuDDing
Backbone=Gemma-2 2B, S...
2026.03
27
SliceGPT
Backbone=Gemma-2 2B, S...
2026.03
27
Magnitude-Dim
Backbone=Gemma-2 2B, S...
2026.03
25
Feedback
Search any
task
Search any
task