GUI Navigation

Benchmarks

Dataset Name	SOTA Method	Metric
AndroidWorld latest (test)	MAI-UI-235B-A22B	Success Rate76.7	35	4d ago
Multimodal-Mind2Web Cross-Website	HTML-T5-XL	Step Success Rate62.2	32	4d ago
Multimodal-Mind2Web Cross-Domain	HTML-T5-XL	Step Success Rate67.1	27	4d ago
Multimodal-Mind2Web Cross-Task	HTML-T5-XL	Step Success Rate71.5	27	4d ago
AITW (test)	CogAgent	Install Success Rate78.86	27	4d ago
Mind2Web (Cross-Website)	DuSAR	Element Accuracy44.6	23	4d ago
Smartphone (test)	MiniCPM-GUI	Type EM76.1	14	4d ago
Web-Multi (test)	Qwen-GUI	Type EM73.1	14	4d ago
Web-Single (test)		Type EM0.81	14	4d ago
WebVoyager	Ovis2.5S-RLOO	Success Rate (Allrecipes)88.89	12	4d ago
Mind2Web Cross-Domain	MiniCPM-GUI	Element Accuracy35.7	12	4d ago
Mind2Web Cross-Task	MiniCPM-GUI	Element Accuracy36.9	12	4d ago
VenusBench-Mobile 1.0 (full)	UI-Venus-1.5-30B-A3B	Success Rate21.5	11	4d ago
Mind2Web Online (Average)	Ovis2.5S-GRPO	Success Rate64	10	4d ago
Online-Mind2Web (Hard)		Success Rate53.52	9	4d ago
Online-Mind2Web (Medium)		Success Rate66.91	9	4d ago
Online-Mind2Web (Easy)	Ovis2.5S-RF++	Success Rate78.31	9	4d ago
Android Control Low 12	iSHIFT	Success Rate87.7	9	4d ago
Android Control High 12	OS Atlas	Success Rate71.17	9	4d ago
OSWorld	BEAP-Agent	Accuracy28.2	9	4d ago
GUIAct Web Single	iSHIFT	Type Accuracy93.83	8	4d ago
GUI Odyssey 15 (Overall)	iSHIFT	Success Rate73.97	7	4d ago
AITW	Qwen-VL	Install Success Rate70.4	7	4d ago
GUIAct (Phone)	iSHIFT	Type Accuracy79.41	6	4d ago
AITZ 1.0 (test)	OS-Kairos	Scroll SR0.9117	5	4d ago

Showing 25 of 33 rows