Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Question Answering on SimpleQA (pass@128)
Loading...
53.97
pass@128
WRAP++
33.9708
39.1629
44.355
49.5471
Apr 8, 2026
pass@128
Updated 9d ago
Evaluation Results
Method
Method
Links
pass@128
WRAP++
Model=OLMo-3-32B, Trai...
2026.04
53.97
WRAP++
Model=OLMo-3-7B, Train...
2026.04
49.13
Extended WRAP
Model=OLMo-3-32B, Trai...
2026.04
47.91
WRAP
Model=OLMo-3-32B, Trai...
2026.04
44.43
Extended WRAP
Model=OLMo-3-7B, Train...
2026.04
43.69
Pretrained Base
Model=OLMo-3-32B, Trai...
2026.04
42.35
WRAP
Model=OLMo-3-7B, Train...
2026.04
39.55
+ WRAP++ Mix (100B)
Setting=+ WRAP++ Mix (...
2026.04
37.58
Pretrained Base
Model=OLMo-3-7B, Train...
2026.04
34.76
Pretrained Base
Setting=Pretrained Base
2026.04
34.76
+ Midtrain (100B)
Setting=+ Midtrain (100B)
2026.04
34.74
Feedback
Search any
task
Search any
task