Share your thoughts, 1 month free Claude Pro on usSee more

Open-ended Question Answering on PUB-OE v3 (test)

37.7Subpart AND (v3)

Physics-R1 (dense)

Updated 19d ago

Evaluation Results

Method	Links
Physics-R1 (dense) 2026.05		37.7
Physics-R1 (binary, seed 42) 2026.05		37
Qwen3-VL-8B-Thinking (base) 2026.05		35.3
Physics-R1 (binary, 3-seed mean ±σ) 2026.05		34.8
Gemini 2.5 Pro 2026.05		33.4
Qwen3-VL-32B-Thinking 2026.05		32.8
GPT-4o 2026.05		31
Claude Sonnet 4.5 2026.05		25.4
InternVL3-8B 2026.05		23.5