Share your thoughts, 1 month free Claude Pro on usSee more

Web Navigation on Mind2Web

58.7Overall Success Rate

Triton-GRPO-32B

Updated 1mo ago

Evaluation Results

Method
Triton-GRPO-32B 2026.04	58.7	-	-	-	70.1	-
CogAgent 2023.12	58.2	62.3	54	59.4	-	-
LLaMA2-70B 2023.12	54.4	55.8	51.6	55.7	-	-
Triton-ORPO-32B 2026.04	53.2	-	-	-	63.4	-
LLaMA2-7B 2023.12	50.1	52.7	47.1	50.3	-	-
Triton-SFT-32B 2026.04	47.6	-	-	-	60.5	-
Flan-T5XL 2023.12	43.5	52	38.9	39.6	-	-
GPT-4.5-preview-2025-02-27 2026.04	42.4	-	-	-	59.8	-
Gemini-2.5-pro-preview-05-06 2026.04	41.5	-	-	-	59.1	-
Claude-4-5-noThink 2026.04	41.4	-	-	-	58.8	-
Grok-3 2026.04	41.1	-	-	-	58.5	-
o4-mini-2025-04-16 2026.04	39.2	-	-	-	56.8	-
Gemini-2.5-Flash-preview-04-17 2026.04	38	-	-	-	55.3	-
Grok-3-fast 2026.04	36.6	-	-	-	54.2	-
Gemini-2.0-Flash 2026.04	35	-	-	-	53.1	-
GPT-4.1-mini-2025-04-14 2026.04	33.2	-	-	-	52	-
GPT-4 2023.12	30.9	36.2	30.1	26.4	-	-
GPT-4.1-nano-2025-04-14 2026.04	28.4	-	-	-	48.4	-
DeepSeek-V3 2026.04	25.2	-	-	-	43.4	-
CogVLM 2023.12	23.9	37.1	23.4	26.3	-	-
Mem-W-8B 2026.05	23.53	-	-	-	-	-
Mem-W-4B 2026.05	22.55	-	-	-	-	-
Mem-W-7B 2026.05	20.59	-	-	-	-	-
MAI-UI-2B 2026.05	19.41	-	-	-	-	-
Qwen3-32B-Instruct Chat 2026.04	17.7	-	-	-	36.9	-
GPT-3.5 2023.12	17.4	18.6	17.4	16.2	-	-
Qwen3-VL-8B 2026.05	13.73	-	-	-	-	-
Qwen3-VL-32B 2026.05	13.73	-	-	-	-	-
Qwen3-VL-4B 2026.05	13.72	-	-	-	-	-
Step-GUI-4B 2026.05	12.75	-	-	-	-	-
Qwen3-4B-Instruct Chat 2026.04	11.2	-	-	-	29.7	-
GLM-4.1V-9B-Thinking 2026.05	10.78	-	-	-	-	-
Qwen-VL 2023.12	10.2	12.6	10.1	8	-	-
Qwen2.5-VL-7B 2026.05	9.8	-	-	-	-	-
Qwen3-VL-2B 2026.05	9.8	-	-	-	-	-
GUI-Owl-1.5-8B 2026.05	8.82	-	-	-	-	-
Qwen3-1.7B-Instruct Chat 2026.04	6.4	-	-	-	23.9	-
UI-TARS-1.5-7B 2026.05	5.88	-	-	-	-	-
UI-Venus-1.5-8B 2026.05	5.88	-	-	-	-	-
UI-Venus-1.5-30B-A3B 2026.05	3.92	-	-	-	-	-
Qwen3-0.6B-Instruct Think 2026.04	0	-	-	-	3.5	-
SeeClick 2026.06	-	-	-	-	-	33.4
SeeClick + GUI-PRA 2026.06	-	-	-	-	-	36.2
SeeClick + BacktrackAgent 2026.06	-	-	-	-	-	36.9
SeeClick + GUI-Critic-R1 2026.06	-	-	-	-	-	37.2
SeeClick + VisCritic 2026.06	-	-	-	-	-	37.6
ShowUI 2026.06	-	-	-	-	-	43.5
ShowUI + GUI-PRA 2026.06	-	-	-	-	-	46.2
ShowUI + VisCritic 2026.06	-	-	-	-	-	48.9
CogAgent 2026.06	-	-	-	-	-	41.2
CogAgent + VisCritic 2026.06	-	-	-	-	-	44.7
Qwen2.5-VL Agent 2026.06	-	-	-	-	-	47.3
Qwen2.5-VL Agent + GUI-PRA 2026.06	-	-	-	-	-	50.1
Qwen2.5-VL Agent + GuidNav 2026.06	-	-	-	-	-	51.2
Qwen2.5-VL Agent + GUI-Critic-R1 2026.06	-	-	-	-	-	51.8
Qwen2.5-VL Agent + VisCritic 2026.06	-	-	-	-	-	54.1