Share your thoughts, 1 month free Claude Pro on usSee more

Mathematical Reasoning on MATH 500 (mean wall-clock time)

40.2Mean Wall-Clock Time

h2o

Updated 29d ago

Evaluation Results

Method	Links
h2o 2026.06		40.2
h2o 2026.06		71.4
h2o 2026.06		91.4
kv-key 2026.06		113.4
kv-val 2026.06		113.5
band-adaptive 2026.06		113.8
lag-kv-key 2026.06		116.3
lag-kv 2026.06		119.5
EPIKV 2026.06		125
hs-variance 2026.06		128.8
kv-val 2026.06		152.5
band-adaptive 2026.06		155.3
kv-key 2026.06		156
lag-kv-key 2026.06		158.3
lag-kv 2026.06		163.4
none 2026.06		180
EPIKV 2026.06		181.9
hs-variance 2026.06		181.9
hybrid-seg-hs 2026.06		193.8
attn×hs 2026.06		211.5
hybrid-seg-hs 2026.06		222.5
band-adaptive 2026.06		246.3
raas 2026.06		246.6
kv-key 2026.06		248.7
kv-val 2026.06		249.4
lag-kv-key 2026.06		251
lag-kv 2026.06		252
lag-kv 2026.06		267.5
lag-kv-key 2026.06		269.1
kv-val 2026.06		271.5
band-adaptive 2026.06		272.4
kv-key 2026.06		273.5
EPIKV 2026.06		276.9
hs-variance 2026.06		282.2
attn×hs 2026.06		290.5
hybrid-seg-hs 2026.06		309.2
raas 2026.06		317.8
EPIKV 2026.06		319.9
hs-variance 2026.06		342.1
thinKV 2026.06		344.6
thinKV 2026.06		399.4
attn×hs 2026.06		414.4
thinKV 2026.06		416.5
hybrid-seg-hs 2026.06		420.9
raas 2026.06		515.8
thinKV 2026.06		520.2
attn×hs 2026.06		572.1
h2o 2026.06		628
raas 2026.06		873.3