Share your thoughts, 1 month free Claude Pro on usSee more

Binary decision on PLASMA

84.5Accuracy

IDEA

Updated 1mo ago

Evaluation Results

Method	Links
IDEA 2026.04		84.5
IDEA 2026.04		83.9
CoT 2026.04		82.9
Vanilla 2026.04		82
IDEA w/o MC 2026.04		82
Vanilla 2026.04		81.1
IDEA w/o Inter 2026.04		80.2
IDEA 2026.04		80.2
BIRD 2026.04		79.9
Logit 2026.04		79.7
IDEA w/o MC 2026.04		79.5
IDEA w/o Inter 2026.04		79.3
Vanilla 2026.04		78.1
IDEA w/o Inter 2026.04		76.8
IDEA w/o EM 2026.04		76.6
Logit 2026.04		76.4
IDEA w/o EM 2026.04		76.3
CoT 2026.04		75.9
IDEA w/o EM 2026.04		75.7
Logit 2026.04		75.6
CoT 2026.04		75.4
BIRD 2026.04		75.3
IDEA w/o MC 2026.04		75.2
CoT 2026.04		75.1
CoT 2026.04		73.7
BIRD 2026.04		73.3
Random 2026.04		50