Share your thoughts, 1 month free Claude Pro on usSee more

GUI Agent Task on MemGUI-Bench Hard

34.2P@1

MemGUI-Agent-235B

Updated 1mo ago

Evaluation Results

Method	Links
MemGUI-Agent-235B 2026.06		34.2	55.3	46.5
Qwen3-VL-235B-Thinking 2026.06		26.3	44.7	28.2
M3A 2026.06		21.1	44.7	36.4
Qwen3-VL-235B-Instruct 2026.06		21.1	28.9	32.2
MemGUI-8B-SFT 2026.06		21.1	34.2	32.6
Agent-S2 2026.06		18.4	36.8	36.9
T3A 2026.06		18.4	34.2	-
Qwen3-VL-32B-Instruct 2026.06		7.9	21.1	13.8
GUI-Owl-1.5-8B-Instruct 2026.06		7.9	10.5	14.2
Qwen3-VL-8B-Instruct 2026.06		2.6	7.9	9.5
GUI-Owl-7B 2026.06		2.6	2.6	2.6
Mobile-Agent-E 2026.06		0	2.6	1.8
Mobile-Agent-V2 2026.06		0	0	0
SeeAct 2026.06		0	0	0
AppAgent 2026.06		0	0	0
GUI-Owl-1.5-32B-Instruct 2026.06		0	5.3	15.3
UI-TARS-1.5-7B 2026.06		0	0	0.9
UI-Venus-7B 2026.06		0	0	0
CogAgent 2026.06		0	0	0