Our new X account is live! Follow @wizwand_team for updates

Science Question Answering on ScienceQA v1.0 (test)

82.5Accuracy (G1-4)

AUTOACT

Updated 3d ago

Evaluation Results

Method	Links
AUTOACT 2024.01		82.5	72.5	80.83	78.61
Chameleon 2024.01		77.83	69.17	76.67	74.56
Zero-Shot Plan* 2024.01		76.67	61.67	78.33	72.22
Reflexion 2024.01		75.83	67.5	78.33	73.89
CoT 2024.01		74.17	64.17	75.83	71.39
FireAct 2024.01		72.5	68.33	75	71.94
AUTOACT 2024.01		70.83	66.67	76.67	71.39
BOLAA 2024.01		70	67.5	75	70.83
AUTOACT 2024.01		69.17	68.33	72.5	70
Chameleon 2024.01		69.17	60.83	73.33	67.78
Reflexion 2024.01		67.5	65.83	69.17	67.5
Reflexion 2024.01		67.5	64.17	73.33	68.33
Chameleon 2024.01		65.83	62.5	66.67	65
FireAct 2024.01		65	62.5	64.17	63.89
ReWOO 2024.01		65	61.67	76.67	67.78
BOLAA 2024.01		64.17	61.67	65.83	63.89
ReAct 2024.01		64.17	60	72.5	65.56
ReAct 2024.01		63.33	58.33	62.5	61.39
CoT 2024.01		61.67	52.5	69.17	61.11
CoT 2024.01		60.83	55.83	65	60.56
ReWOO 2024.01		60.83	58.33	64.17	61.11
FireAct 2024.01		60.83	57.5	67.5	61.94
BOLAA 2024.01		60	54.17	65.83	60
ReAct 2024.01		57.5	51.67	65	58.06
ReWOO 2024.01		57.5	54.17	65.83	59.17
CoT 2024.01		54.17	50	60	54.72