Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Motif

Benchmarks

Task NameDataset NameSOTA ResultTrend
Graph ClassificationMotif (size)
Accuracy92.4
43
Graph ClassificationMotif base
Accuracy92.5
43
Graph ClassificationMotif correlation shift (test)
Accuracy82.51
25
Graph ClassificationMotif (size) OOD
Accuracy55.3
14
Graph ClassificationMotif basis OOD
Accuracy73.6
14
Graph ClassificationMotif GOOD (basis)
ROC-AUC0.6977
14
Graph ClassificationMotif GOOD size
ROC AUC63.71
14
Graph ClassificationMotif OOD GraphOOD (test)
Accuracy77.43
13
Graph ClassificationMotif GraphOOD (test)
Accuracy77.96
13
Element GroundingMOTIF (test)
Grounding Accuracy78.8
13
UI Navigation / Task CompletionMoTIF (test)
Success Rate87.4
2
Showing 11 of 11 rows