Share your thoughts, 1 month free Claude Pro on usSee more

Spatial Question Answering on OST-Bench 1,396 QA pairs

65.04Average Score

TRACE

Updated 25d ago

Evaluation Results

Method	Links
TRACE 2026.03		65.04	91.85	57.52	61.22	100	87.3	69.15	24.56	32.35	74.87	42.42	26.44	100	29.07	94.52	38.06
CM 2026.03		64	88.59	54.9	57.14	100	88.89	69.15	21.05	33.92	78.89	36.36	27.53	100	11.85	97.26	38.89
LtM 2026.03		63.75	88.04	44.44	63.27	100	88.89	77.11	21.05	35.88	76.88	40.91	22.33	100	7.78	100	36.94
Direct 2026.03		62.65	92.39	51.63	53.06	100	85.71	63.68	21.05	34.12	76.38	40.91	28.77	100	9.26	91.78	40.28
ToT 2026.03		62.2	91.3	52.29	51.02	100	90.48	64.68	15.79	29.22	75.38	40.91	27.53	100	15.74	84.93	41.39
CoT 2026.03		61.69	89.67	48.37	48.98	100	82.54	68.66	15.79	33.33	75.38	39.39	28.77	97.14	11.3	89.04	39.31
TRACE 2026.03		60.42	95.05	86.58	66.67	96.43	77.78	57	52.73	34.12	60.3	56.45	31.25	54.29	31.92	76.71	29.03
LtM 2026.03		59.27	95.65	85.52	66.67	100	76.19	53	50.91	25.88	55.78	53.03	31.23	71.43	35.85	69.86	18.06
CoT 2026.03		59.26	82.24	93.99	65.96	96.55	77.78	52.24	62.96	27.84	52.76	50	31.64	71.43	24.26	72.6	26.67
Direct 2026.03		59.22	96.72	84.87	68.75	89.66	82.54	54.27	48.15	28.63	60.61	54.55	30	71.43	22.78	72.6	22.68
ToT 2026.03		59.2	94.54	83.55	66.67	93.1	80.65	54.27	54.39	31	55.61	53.85	32.36	61.76	29.07	72.6	24.58
CM 2026.03		59.04	95.05	86.18	68.75	89.66	77.78	55.72	48.15	25.4	60.3	49.23	26.3	80	24.81	69.86	28.47