Share your thoughts, 1 month free Claude Pro on usSee more

Mobile GUI Navigation on MobileWorld GUI-Only 117 tasks (test)

43.9Pass@1 Success Rate

GUI-Owl-1.5-32B-Instruct

Updated 1mo ago

Evaluation Results

Method	Links
GUI-Owl-1.5-32B-Instruct 2026.06		43.9
GUI-Owl-1.5-32B 2026.06		43.9
ForgeOwl-8B 2026.06		41
MAI-UI-235B-A22B 2026.06		39.7
MAI-UI-235B-A22B 2026.06		39.7
GUI-Owl-1.5-8B-Instruct 2026.06		38.2
GUI-Owl-1.5-8B 2026.06		37.6
MAI-UI-32B 2026.06		36.2
MAI-UI-32B 2026.06		36.2
GUI-Owl-1.5-2B-Instruct 2026.06		32.2
GUI-Owl-1.5-2B 2026.06		32.2
MemGUI-Agent-235B 2026.06		29.1
MAI-UI-8B 2026.06		27.5
MAI-UI-8B 2026.06		27.5
MemGUI-8B-SFT 2026.06		17.9
OpenMobile-8B 2026.06		17.7
OpenMobile-8B 2026.06		17.7
ClawGUI-2B 2026.06		17.1
ClawGUI-2B 2026.06		17.1
OpenMobile-7B 2026.06		14.8
OpenMobile-7B 2026.06		14.8
Qwen3-VL-235B-Thinking 2026.06		14.5
Qwen3-VL-235B-Thinking 2026.06		14.5
Qwen3-VL-235B-Instruct 2026.06		12.8
Qwen3-VL-235B 2026.06		12.8
Qwen3-VL-32B-Instruct 2026.06		11.9
Qwen3-VL-32B 2026.06		11.9
ForgeQwen3-8B 2026.06		10.3
Qwen3-VL-8B-Instruct 2026.06		9.4
ScaleCUA-7B 2026.06		7.7
ScaleCUA-7B 2026.06		7.7
Qwen3-VL-8B 2026.06		7.6