Share your thoughts, 1 month free Claude Pro on usSee more

GUI Navigation on AITW

67.3Overall Success Rate

Qwen-GUI

Updated 1mo ago

Evaluation Results

Method	Links
Qwen-GUI 2024.06		67.3	70.3	61.2	71.6	66.1	-	-	-	-	-	-	-	-
Qwen-VL 2024.06		65.8	70.4	57.8	70.1	64.7	-	-	-	-	-	-	-	-
SeeClick 2024.06		60.6	66.4	54.9	63.5	57.6	-	-	-	-	-	-	-	-
NaviMaster 2025.08		59.72	-	-	-	-	74.92	-	-	-	-	-	-	-
MiniCPM-GUI 2024.06		58.4	62.3	46.5	67.3	57.5	-	-	-	-	-	-	-	-
NaviMaster 2025.08		58.05	-	-	-	-	71.31	-	-	-	-	-	-	-
GUI-R1-7B 2025.08		55.31	-	-	-	-	62.94	-	-	-	-	-	-	-
UI-shift 2025.08		54.38	-	-	-	-	74.44	-	-	-	-	-	-	-
Aguvis 2025.08		53.06	-	-	-	-	69.57	-	-	-	-	-	-	-
NaviMaster 2025.08		49.17	-	-	-	-	74.95	-	-	-	-	-	-	-
MiniCPM-V 2024.06		48.9	50.2	45.1	56.2	44	-	-	-	-	-	-	-	-
GoClick-L w/ Intent Gnd. 2026.04		48.9	50	49.7	54.4	44.5	-	45.9	57.4	59	57.1	69.7	60.5	59.7
Qwen2.5VL-7B 2025.08		48.81	-	-	-	-	62.51	-	-	-	-	-	-	-
UI-AGILE 2025.08		48.66	-	-	-	-	75.72	-	-	-	-	-	-	-
GoClick-L w/ Func. Gnd. 2026.04		47.6	47.1	47.9	53.5	44	-	45.7	56.9	51.2	54.1	67.4	59.7	57.5
GoClick-L w/ Intent Gnd. 2026.04		47.2	44.1	49.5	59.7	39.8	-	43.1	48.1	52.9	54.6	67.4	54.8	54
infiGUI-3B 2025.08		46.51	-	-	-	-	75.58	-	-	-	-	-	-	-
GoClick-L w/ Func. Gnd. 2026.04		46.4	40.9	48.5	59.4	40	-	43.2	48.4	47.4	52.9	66.8	55	52.5
Qwen2.5VL-7B 2025.08		45.8	-	-	-	-	65.99	-	-	-	-	-	-	-
Fuyu-GUI 2024.06		45.5	50.9	41.6	45.7	43.8	-	-	-	-	-	-	-	-
Fuyu-8B 2024.06		43.5	45.9	40	47.2	40.8	-	-	-	-	-	-	-	-
GPT-4o + SoM 2026.04		42.1	43.2	41.4	53	39.2	-	33.7	37.2	53.8	51.8	63.2	51	50.4
OS-Atlas-7B 2025.08		41.38	-	-	-	-	64.89	-	-	-	-	-	-	-
Gemini-2-Flash-Exp + SoM 2026.04		34.8	33.9	33.9	48.5	27.9	-	29.9	32.2	41.4	30.1	56.8	37.8	38.3
Gemini-2-Flash-Exp 2026.04		29.5	28.5	30.3	41.9	20.2	-	26.4	18.2	26.9	22.9	29	22.7	23.6
GPT-4o 2026.04		27.2	32.9	31.9	44.2	25.9	-	28.2	24.9	30.1	27.6	47.1	30	29.9
GPT-4o 2025.08		26.07	-	-	-	-	35.75	-	-	-	-	-	-	-