Arithmetic Reasoning on SingleEq

98.8Accuracy

PAL

Updated 2d ago

Evaluation Results

Method
PAL 2023.05	98.8	-	-	-
Automatic Model Selection with LLMs 2023.05	98.6	-	-	-
Automatic Model Selection with LLMs 2023.05	97.8	-	-	-
PAL 2023.05	97.6	-	-	-
CoT 2023.05	97.4	-	-	-
CoT 2023.05	97.2	-	-	-
Automatic Model Selection with LLMs 2023.05	96.9	-	-	-
PAL 2023.05	96.5	-	-	-
DUP 2024.04	96	-	-	-
CoT 2023.05	95.5	-	-	-
Zero-shot PS+ 2024.04	95.3	-	-	-
Zero-shot CoT 2024.04	95	-	-	-
Least-to-Most 2024.04	95	-	-	-
DIVERSE 2022.06	94.9	-	-	-
DUP 2024.04	94.9	-	-	-
Auto-CoT 2024.04	94.6	-	-	-
Manual-CoT 2024.04	94.2	-	-	-
Self-Consistency 2022.06	93.7	-	-	-
Zero-shot CoT 2024.04	93.5	-	-	-
Least-to-Most 2024.04	93.5	-	-	-
Zero-shot PS+ 2024.04	93	-	-	-
SOTA (Fine-tuned) 2022.06	91.2	-	-	-
Greedy Decode 2022.06	87.5	-	-	-
Self-Consistency 2022.06	87.2	-	-	-
Auto-CoT 2022.10	87	-	-	-
Manual-CoT 2022.10	86.6	-	-	-
DIVERSE 2022.06	86.5	-	-	-
Few-Shot 2022.10	82.7	-	-	-
Self-Consistency 2022.06	80.7	-	-	-
Greedy Decode 2022.06	79.5	-	-	-
CoRe 2022.10	79.5	-	-	-
zero-shot* 2022.10	78.7	-	-	-
zero-shot-CoT* 2022.10	78.7	-	-	-
Zero-Shot 2022.10	78.7	-	-	-
Zero-Shot-CoT 2022.10	78.7	-	-	-
zero-shot-CoT 2022.10	78	-	-	-
Greedy Decode 2022.06	76.9	-	-	-
zero-shot 2022.10	74.6	-	-	-
DIVERSE 2022.06	65.1	-	-	-
Self-Consistency 2022.06	63.1	-	-	-
Self-Consistency 2022.06	59.6	-	-	-
Greedy Decode 2022.06	56.6	-	-	-
Greedy Decode 2022.06	38.2	-	-	-
0-shot CoT 2023.05	-	-	-	48.8
Auto-CoT 2023.05	-	-	-	58.1
COSP 2023.05	-	-	-	64.8
5-shot CoT 2023.05	-	-	-	65.9
0-shot CoT 2023.05	-	-	-	74.4
Auto-CoT 2023.05	-	-	-	77.8
COSP 2023.05	-	-	-	78.7
5-shot CoT 2023.05	-	-	-	79.8
0-shot CoT 2023.05	-	-	-	88.6
Auto-CoT 2023.05	-	-	-	85.6
COSP 2023.05	-	-	-	90.4
5-shot CoT 2023.05	-	-	-	89.2
zero-shot 2022.05	-	74.6	78.7	-
zero-shot-cot 2022.05	-	78	78.7	-