Share your thoughts, 1 month free Claude Pro on usSee more

Accuracy on Physical Commonsense Reasoning on PIQA

81.5Accuracy (PIQA)

Thoughts-as-Planning

Updated 5d ago

Evaluation Results

Method	Links
Thoughts-as-Planning 2026.04		81.5
Original 2026.05		81.28
DEEPSEEK-7B 2025.06		79.27
CoTGen 2026.04		79.2
RLCoT 2026.04		78.8
Accuracy (Arc-E) 2026.05		78.51
LLAMA-2-7B 2025.06		78.07
AutoCoT 2026.04		78
SoftCoT 2026.04		77.9
Taylor 2026.05		76.55
Accuracy (Ours) 2026.05		76.55
Manual CoT 2026.04		76.5
FIXED_E=128 2026.05		76.44
Memory Grafting 2026.05		76.17
MaskPro 2025.06		75.87
GBLM 2025.06		75.73
Vanilla Engram 2026.05		75.63
WANDA 2025.06		75.46
MoE Baseline 2026.05		75.41
Out. Cosine-Sim 2026.05		75.3
SPARSEGPT 2025.06		75.24
Oryx-TM (Mamba-2) 2026.05		75.2
PRUNER-ZERO 2025.06		75.12
Oryx-TG (Gated DeltaNet) 2026.05		75.1
Gated DeltaNet 2026.05		75
Oryx-TM (Transformer) 2026.05		75
Oryx-TG (Transformer) 2026.05		74.9
Out. Norm-Sim 2026.05		74.86
EMO (Stage 5) 2026.05		74.81
Mamba-2 2026.05		74.7
MaskPro 2025.06		74.65
GBLM 2025.06		74.16
WANDA 2025.06		74.14
Transformer 2026.05		74.1
PRUNER-ZERO 2025.06		74.07
Oryx-TM (Mamba-2) 2026.05		73.9
Out. Divergence-Sim 2026.05		73.83
SPARSEGPT 2025.06		73.78
FIXED_E=32 2026.05		73.78
Slice-GPT 2026.05		73.66
Oryx-TM (Transformer) 2026.05		73.6
EMO (Stage 4) 2026.05		73.5
Cosine Similarity 2026.05		73.23
Transformer 2026.05		73.1
Oryx-TG (Gated DeltaNet) 2026.05		73.1
FIXED_E=16 2026.05		73.01
Oryx-TG (Transformer) 2026.05		72.8
Mamba-2 2026.05		72.7
Accuracy (C4) 2026.05		72.63
Gated DeltaNet 2026.05		72.5
MAGNITUDE 2025.06		72.42
Muon 2026.05		72.2
MAGNITUDE 2025.06		72.2
Mamba-2 2026.05		72.1
Oryx-TG (Transformer) 2026.05		71.6
Oryx-TM (Mamba-2) 2026.05		71.3
Oryx-TG (Gated DeltaNet) 2026.05		71.3
AdamW 2026.05		71.27
Pion 2026.05		71.27
EMO (Stage 3) 2026.05		71.27
Gated DeltaNet 2026.05		71.2
Oryx-TM (Transformer) 2026.05		71.2
Transformer 2026.05		70.8
EMO (Stage 2) 2026.05		70.13
EMO (Stage 1) 2026.05		69.91
Muon32 2026.05		69.6
Muon8 2026.05		69.6
MOE+Lngram 2026.05		69.26
MOE+Engram 2026.05		68.44
Gated DeltaNet 2026.05		68.4
MuonQ4 2026.05		68.3
MOE 2026.05		68.01
Oryx-TM (Transformer) 2026.05		67.7
MOE+Lngram-23L 2026.05		67.4
Oryx-TM (Mamba-2) 2026.05		67.4
Oryx-TG (Transformer) 2026.05		67.3
Muon32 2026.05		67.2
Mamba-2 2026.05		67.1
Oryx-TG (Gated DeltaNet) 2026.05		67.1
Transformer 2026.05		66.8
Perplexity 2026.05		66.76
Muon8 2026.05		66.7
Muon32 2026.05		65.7
MuonQ4 2026.05		65.2
Muon32 2026.05		65.1
Muon8 2026.05		64.6
MuonQ4 2026.05		63.7
Muon8 2026.05		63.4
MuonQ4 2026.05		63.1
Gaussian-Base 2026.05		59.3
Gaussian-Gaussian 2026.05		59.3
Muon4 2026.05		58.7
Muon4 2026.05		58.2
Muon4 2026.05		58.2
Base 2026.05		56.8
Base-Gaussian 2026.05		56.47
Muon4 2026.05		55.9
Gaussian 2026.05		53.75
Base 2026.05		52.12