Share your thoughts, 1 month free Claude Pro on usSee more

Motion Reasoning on ReMoT 16k (test)

31.5Navigation: Camera (Overall)

SFT↔GRPO

Updated 1mo ago

Evaluation Results

Method	Links
SFT↔GRPO 2026.02		31.5	68.8	23.3	40	93.3	79.8	89.5	45.2	65.1	64.5	83.3	39.9	67.7
GRPO 2026.02		27	62.4	24.3	44.3	94.1	54.5	74.3	27.3	44.7	61.3	79.2	33.6	61.6
GRPO 2026.02		27	62.4	24.3	44.3	94.1	54.5	74.3	27.3	44.7	61.3	79.2	33.6	61.6
SFT→GRPO 2026.02		26.6	62.1	22.5	35.8	82.5	57.3	78.8	32.3	60.2	62.9	82.3	35	63.3
SFT→GRPO 2026.02		26.6	62.1	22.5	35.8	82.5	57.3	78.8	32.3	60.2	62.9	82.3	35	63.3
Gemini-2.5-Pro 2026.02		25	62.5	25	25	75	12.5	41.7	0	16.7	25	50	26.4	49.1
SFT↔GRPO 2026.02		21.4	61.2	26.7	46.7	82.7	68.6	82	45.2	65.1	69.4	86.6	38	64
SFT↔GRPO 2026.02		21.4	61.2	26.7	46.7	82.7	68.6	82	45.2	65.1	69.4	86.6	38	64
Qwen2.5-VL-7B 2026.02		4.8	34.7	0	23.9	0	4	36.6	8.1	31.7	0	16.7	5.1	25.4
Qwen2.5-VL-7B 2026.02		4.8	34.7	0	23.9	0	4	36.6	8.1	31.7	0	16.7	5.1	25.4
InternVL3-8B 2026.02		2.8	23.8	15	30.6	51.7	1.6	28.5	8.1	38.7	0	18.3	12.2	28.9
InternVL3-8B 2026.02		2.8	23.8	15	30.6	51.7	1.6	28.5	8.1	38.7	0	18.3	12.2	28.9
Qwen3-VL-CoT-4B 2026.02		2.4	25.9	22.5	35.8	79	15.3	46.2	3.2	35.5	4.8	22	20.7	38.9
Qwen3-VL-CoT-4B 2026.02		2.4	25.9	22.5	35.8	79	15.3	46.2	3.2	35.5	4.8	22	20.7	38.9
LLaVA-One-Vision 2026.02		2	30.4	17.5	32.9	0	10.5	37.6	21	47.3	0	14.8	9.7	27.9
LLaVA-One-Vision 2026.02		2	30.4	17.5	32.9	0	10.5	37.6	21	47.3	0	14.8	9.7	27.9
InternVL3-2B 2026.02		1.6	21.5	20	31.3	60.5	0.8	29.8	6.5	35	0	17.7	14.9	29.3
InternVL3-2B 2026.02		1.6	21.5	20	31.3	60.5	0.8	29.8	6.5	35	0	17.7	14.9	29.3
GPT-5-Chat 2026.02		0	31.3	0	0	75	0	37.5	25	41.7	0	33.4	10.4	33.3
SFT 2026.02		0	2.4	23.3	40	37.9	0	10.5	0	9.7	0	9.2	10.4	15.4