Share your thoughts, 1 month free Claude Pro on usSee more

Symbolic Reasoning on Last Letter

0.819Accuracy

In-Writing-BF

Updated 20d ago

Evaluation Results

Method	Links
In-Writing-BF 2026.01		0.819
In-Writing-BF 2026.01		0.803
In-Writing-IF 2026.01		0.792
In-Writing-BF 2026.01		0.787
In-Writing-IF 2026.01		0.779
In-Writing-Base 2026.01		0.774
In-Writing-IF 2026.01		0.77
In-Writing-Base 2026.01		0.759
In-Writing-BF 2026.01		0.749
In-Writing-Base 2026.01		0.747
In-Writing-BF 2026.01		0.74
In-Writing-IF 2026.01		0.733
In-Writing-IF 2026.01		0.731
ZS-CoT (teacher) 2026.05		0.724
In-Writing-Base 2026.01		0.708
Vanilla-KD 2026.05		0.708
In-Writing-BF 2026.01		0.704
In-Writing-IF 2026.01		0.702
NL-to Format 2026.01		0.701
In-Writing-Base 2026.01		0.691
GateKD 2026.05		0.679
NL-to Format 2026.01		0.676
Mentor-KD 2026.05		0.638
GateKD 2026.05		0.625
MCC-KD 2026.05		0.603
Vanilla-KD 2026.05		0.589
Mentor-KD 2026.05		0.581
MCC-KD 2026.05		0.54
Vanilla-KD 2026.05		0.524
NL-to Format 2026.01		0.446
In-Writing-Base 2026.01		0.431