Share your thoughts, 1 month free Claude Pro on usSee more

Open-ended Question Answering on PhysReason v2 (test)

51.1Subpart-AND (v2)

GPT-4o

Updated 19d ago

Evaluation Results

Method	Links
GPT-4o 2026.05		51.1
Claude Sonnet 4.5 2026.05		49.1
Physics-R1 (binary, 3-seed mean ±σ) 2026.05		39.6
Gemini 2.5 Pro 2026.05		38.8
Physics-R1 (binary, seed 42) 2026.05		32.2
Qwen3-VL-32B-Thinking 2026.05		25.1
Qwen3-VL-8B-Thinking (base) 2026.05		23.9
Physics-R1 (dense) 2026.05		23.3
InternVL3-8B 2026.05		13.3