Share your thoughts, 1 month free Claude Pro on usSee more

Common Sense Reasoning on NoRa Irrelevant Rationales

60Accuracy

SC

Updated 1mo ago

Evaluation Results

Method	Links
SC 2024.10		60
CD-CoT 2024.10		57.7
CD-CoT 2024.10		55.7
CD-CoT 2024.10		54.7
Base 2024.10		53.2
CC 2024.10		50.2
CD-CoT 2024.10		49.7
SC 2024.10		46.7
SC 2024.10		46
CC 2024.10		45.6
SC 2024.10		45
SC 2024.10		44.7
CC 2024.10		43.6
SC 2024.10		42.7
Base 2024.10		42.3
Base 2024.10		41.9
CC 2024.10		40.8
CD-CoT 2024.10		40.3
CD-CoT 2024.10		40.3
Base 2024.10		40.2
CD-CoT 2024.10		39.7
CD-CoT 2024.10		39.3
BT 2024.10		37.8
SC 2024.10		37.7
SC 2024.10		37
BT 2024.10		36.2
BT 2024.10		36.1
CC 2024.10		36
CC 2024.10		35.7
Base 2024.10		35.5
Base 2024.10		34.9
Base 2024.10		33.4
BT 2024.10		33.3
Base 2024.10		31.1
CC 2024.10		29.9
BT 2024.10		28.3
CC 2024.10		28.3
BT 2024.10		11
BT 2024.10		10.5
BT 2024.10		6.2