Our new X account is live! Follow @wizwand_team for updates

Arithmetic Reasoning on SVAMP (Accuracy)

94.2Accuracy

DUP

Updated 2d ago

Evaluation Results

Method	Links
DUP 2024.04		94.2
Zero-shot PS+ 2024.04		92.6
Zero-shot CoT 2024.04		90.4
Least-to-Most 2024.04		90.3
Base 2024.05		87.6
Self-consistency 2022.03		86.8
Self-consistency 2022.03		86.6
TAIA 2024.05		86.2
CoK + SC 2023.06		86
ComplexCoT + SC 2023.06		85.6
Manual CoT + SC 2023.06		85
Base 2024.05		83.6
TAIA 2024.05		83.1
Auto-CoT 2024.04		82.9
LoRA 2024.05		82.8
LoRA 2024.05		82.6
DUP 2024.04		82.5
CoK 2023.06		81.4
Least-to-Most 2024.04		80.9
Zero-shot PS+ 2024.04		80.7
Manual CoT 2023.06		79.5
Zero-shot CoT 2024.04		79.3
CoT-prompting 2022.03		79
Manual-CoT 2024.04		78.5
ComplexCoT 2023.06		77.7
CoT-prompting 2022.03		75.8
CoK 2023.06		69.9
Auto-CoT 2022.10		69.5
Auto-CoT 2023.06		69.5
Manual-CoT 2022.10		68.9
Manual CoT 2023.06		68.9
TAIA 2024.05		67.2
Few-Shot 2022.10		65.7
Few-Shot SP 2023.06		65.7
Zero-Shot-CoT 2022.10		63.7
Zero-Shot CoT 2023.06		62.1
Zero-Shot 2022.10		58.8
Zero-Shot SP 2023.06		58.8
Pi et al. (2022) 2022.03		57.4
Fine-tuning 2023.06		57.4
LoRA 2024.05		57.1
Base 2024.05		54.9
Self-consistency 2022.03		54.5
Self-consistency 2022.03		53.3
CoT-prompting 2022.03		39.8
CoT-prompting 2022.03		38.9
Self-consistency 2022.03		19.4
CoT-prompting 2022.03		12.6