Share your thoughts, 1 month free Claude Pro on usSee more

Theory of Mind on BigToM

98.67Accuracy

UserHarness

Updated 6d ago

Evaluation Results

Method	Links
UserHarness 2026.05		98.67
Ledger prompting 2026.05		98.25
UserHarness 2026.05		98.25
UserHarness 2026.05		98.17
UserHarness 2026.05		97.67
Ledger prompting 2026.05		97.25
Ledger prompting 2026.05		97.08
Ledger prompting 2026.05		96.67
Ledger prompting 2026.05		96.5
Ledger prompting 2026.05		96.17
UserHarness 2026.05		95.42
UserHarness 2026.05		95.25
UserHarness 2026.05		94.17
Paradox prompting 2026.05		93.83
UserHarness 2026.05		93.83
Ledger prompting 2026.05		93.5
Ledger prompting 2026.05		92.17
Direct prompting 2026.05		92
Paradox prompting 2026.05		91.83
Mistral-NeMo-12B 2026.05		90.5
UserHarness 2026.05		90.17
OSCToM-8B 2026.05		89.8
UserHarness 2026.05		89.67
Direct prompting 2026.05		88.5
Paradox prompting 2026.05		87.83
Paradox prompting 2026.05		87.33
Direct prompting 2026.05		86.92
AutoToM 2026.05		86.92
Direct prompting 2026.05		86.75
UserHarness 2026.05		86.25
Llama-3.1-8B-Base 2026.05		86
Phi-3-Medium-14B 2026.05		85.5
UserHarness 2026.05		82.83
ExploreToM 2026.05		81
Paradox prompting 2026.05		77.92
SimToM 2026.05		77.5
Paradox prompting 2026.05		77.08
Direct prompting 2026.05		76.42
Paradox prompting 2026.05		76.42
Direct prompting 2026.05		74.42
Paradox prompting 2026.05		74
Direct prompting 2026.05		73.5
Direct prompting 2026.05		72.33
LIMP 2026.05		61.67
BIP-ALM 2026.05		50.33
Qwen2.5-32B 2026.05		47.5
Qwen2.5-14B 2026.05		29.5
Gemma-2-27B 2026.05		18.5