Our new X account is live! Follow @wizwand_team for updates

Symbolic Reasoning on Last Letter Concatenation

90.4Accuracy

Zero-Shot CoT

Updated 3d ago

Evaluation Results

Method	Links
Zero-Shot CoT 2023.10		90.4
Persona Switch 2026.01		84.2
Greedy 2026.01		82.8
Multinomial 2026.01		78
Random Selection 2026.01		77.47
Low-gap Selection 2026.01		75.4
Manual CoT + SC 2023.06		74.5
Role-Play Prompting 2026.01		74.2
Manual CoT 2023.06		73
Persona Switch 2026.01		72.8
Top-p 2026.01		72.2
CoK + SC + F2-V 2023.06		69.7
CoK + SC 2023.06		68.3
Multinomial 2026.01		66.8
Top-k 2026.01		66.8
Greedy 2026.01		65.4
CoK + F2-V 2023.06		65.4
CoK 2023.06		63.1
Random Selection 2026.01		62.53
CoK + F2-V 2023.06		61.1
Top-p 2026.01		61
Auto-CoT 2022.10		59.7
Auto-CoT 2023.06		59.7
CoK 2023.06		59.4
Manual-CoT 2022.10		59
Manual CoT 2023.06		59
PROMPTED 2023.10		58.2
Zero-Shot-CoT 2022.10		57.6
Zero-Shot CoT 2023.06		57.6
Role-Play Prompting 2026.01		56
Low-gap Selection 2026.01		55.2
Top-k 2026.01		54.8
Output Refinement 2023.10		50.8
Persona Switch 2026.01		13.6
Greedy 2026.01		11
Random Selection 2026.01		7.86
Role-Play Prompting 2026.01		6.2
Top-p 2026.01		6
Low-gap Selection 2026.01		5.4
Multinomial 2026.01		5.2
Top-k 2026.01		4.8
Zero-Shot 2023.10		3.2
Zero-Shot 2022.10		0.2
Few-Shot 2022.10		0.2
Zero-Shot SP 2023.06		0.2
Few-Shot SP 2023.06		0