SOTA Arithmetic Reasoning on AddSub (test) and PapersWithCode

96.71Accuracy

CoT + Skill-Based

Updated 29d ago

Evaluation Results

Method	Links
CoT + Skill-Based 2024.05		96.71
CoT + PAL 2024.05		95.7
PAL 2024.05		94.9
CoT 2024.05		93.9
Ours (Natural Program (NP), No Verification) 2023.06		93.67
Ours (NP + Deductive Verification + UPV) 2023.06		93.54
LoRAALL + MoDEK 2024.10		93
LoRAALL 2024.10		92.7
DoRA + MoDEK 2024.10		92.4
CoT + Voting 2023.06		92.36
DoRA 2024.10		92.2
LoRA¬K + MoDEK (+0.04%) 2024.10		92.2
LoRA¬K 2024.10		91.8
REFT 2024.10		91
Faithful CoT + Voting 2023.06		88.35
DoRA + MoDEK 2024.10		51.6
DoRA 2024.10		51.4
LoRAALL + MoDEK 2024.10		51.2
LoRAALL 2024.10		51.1
LoRA¬K + MoDEK (+0.04%) 2024.10		50.1
LoRA¬K 2024.10		49.1
REFT 2024.10		49