Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Action Prediction on MIND2WEB Cross-Domain 1.0
Loading...
42.1
Element Accuracy
MindAct
13.084
20.617
28.15
35.683
Jun 9, 2023
Element Accuracy
Operation F1 Score
Step Success Rate
Success Rate
Updated 4d ago
Evaluation Results
Method
Method
Links
Element Accuracy
Operation F1 Score
Step Success Rate
Success Rate
MindAct
Backbone=Flan-T5-XL
2023.06
42.1
66.5
39.6
2.9
MindAct
Backbone=Flan-T5-Large
2023.06
39.7
67.2
37.3
2.7
MindAct
Backbone=GPT-4, Tasks=...
2023.06
37.1
46.5
26.4
2
MindAct
Backbone=Flan-T5-Base
2023.06
33.9
67.3
31.6
1.6
Classification
Backbone=DeBERTa-Base
2023.06
24.5
-
-
-
MindAct
Backbone=GPT-3.5
2023.06
21.6
52.8
18.6
1
Generation
Backbone=Flan-T5-Base
2023.06
14.2
44.7
11.9
0.4
Feedback
Search any
task
Search any
task