Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Reasoning on BRUMO25 (avg@k, Token reduction)

78.75Avg@k Score

Type IV (STOP)

27.613240.889154.16567.4409Apr 17, 2026
Updated 1mo ago

Evaluation Results

MethodLinks
2026.04
78.75277.578.98
2026.04
76.25284.878.43
2026.04
75.83394.970.1
2026.04
751,320-
2026.04
74.58280.278.78
2026.04
70183.668.11
2026.04
69.17187.667.41
2026.04
68.02575.6-
2026.04
67.9217968.9
2026.04
66.25298.848.09
2026.04
56.67190.271.03
2026.04
52.92194.570.38
2026.04
51.25312.152.46
2026.04
50.99656.6-
2026.04
50199.369.64
2026.04
33.75204.473.61
2026.04
31.67325.657.96
2026.04
31.67209.772.93
2026.04
30.99774.6-
2026.04
29.58212.872.53