Share your thoughts, 1 month free Claude Pro on usSee more

Binary decision on COMMON2SENSE

95.1Accuracy

IDEA

Updated 1mo ago

Evaluation Results

Method	Links
IDEA 2026.04		95.1
CoT 2026.04		95
IDEA 2026.04		94.8
IDEA w/o MC 2026.04		94.7
CoT 2026.04		94.2
CoT 2026.04		93.9
IDEA w/o EM 2026.04		93.5
IDEA 2026.04		93.1
IDEA w/o Inter 2026.04		93
IDEA w/o Inter 2026.04		93
Vanilla 2026.04		93
IDEA w/o Inter 2026.04		92.4
Vanilla 2026.04		91.9
IDEA w/o EM 2026.04		91.8
Vanilla 2026.04		91.7
BIRD 2026.04		91.7
Logit 2026.04		91.5
Logit 2026.04		91.3
BIRD 2026.04		91.3
CoT 2026.04		90.3
IDEA w/o EM 2026.04		89.4
IDEA w/o MC 2026.04		89.2
Logit 2026.04		88.8
CoT 2026.04		88.7
IDEA w/o MC 2026.04		88.7
BIRD 2026.04		88
Random 2026.04		50