Share your thoughts, 1 month free Claude Pro on usSee more

Theory of Mind reasoning on OpenToM narrative

100Location Accuracy (Cg, First)

SFT

Updated 1mo ago

Evaluation Results

Method	Links
SFT 2026.06		100	81	92	56	88	76	49	93.33	71	77.43	-
Thinking RFT 2026.06		99	88	94	67	91	85	57	94.67	80	83	5.57
SFT 2026.06		99	85	96	68	90	79	65	95	77.33	83.14	-
Thinking RFT 2026.06		98	91	97	85	90	87	76	95	87.67	89.14	6
No-Thinking RFT 2026.06		97	84	93	71	88	82	36	92.67	79	78.71	4.43
No-Thinking RFT 2026.06		81	50	81	63	56	55	35	72.67	56	60.14	17.29
AutoToM 2026.06		57	64	60	48	66	60	43	61	57.33	56.86	26.28
Zero-shot 2026.06		51	50	28	15	53	48	39	44	37.67	40.57	36.86
SimToM 2026.06		50	53	44	44	70	40	47	54.67	45.67	49.71	33.43
Zero-shot 2026.06		49	51	48	33	55	53	36	50.67	45.67	46.43	36.71