Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Transitive reasoning on MCG
Loading...
58.5
F1 Score
RegD
23.972
32.936
41.9
50.864
Jan 29, 2025
F1 Score
Updated 3mo ago
Evaluation Results
Method
Method
Links
F1 Score
RegD
Variant=box, d=10
2025.01
58.5
ELBE
Variant=box baseline,...
2025.01
55.5
RegD
Variant=box, d=5
2025.01
50.7
τBox
d=10
2025.01
50.3
ELBE
Variant=box baseline, d=5
2025.01
48.4
RegD
Variant=ball, d=10
2025.01
46.8
OE
d=10
2025.01
46.6
RegD
Variant=ball, d=5
2025.01
44.9
τBox
d=5
2025.01
43.9
ShadowCone*
Variant=Umbral-half, d=10
2025.01
40.1
ELEM
Variant=ball baseline,...
2025.01
38.6
ShadowCone*
Variant=Penumbral-half...
2025.01
37.6
ShadowCone*
Variant=Umbral-half, d=5
2025.01
36.8
OE
d=5
2025.01
36.3
ELEM
Variant=ball baseline,...
2025.01
35.7
ShadowCone*
Variant=Penumbral-half...
2025.01
35
EntailmentCone*
d=10
2025.01
25.5
EntailmentCone*
d=5
2025.01
25.3
Feedback
Search any
task
Search any
task