Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Motif

Benchmarks

Task NameDataset NameSOTA ResultTrend
Graph ClassificationMotif (size)
Accuracy92.4
43
Graph ClassificationMotif base
Accuracy92.5
43
Node-level explanationMOTIF
Fidelity F181.6
32
Graph ClassificationMotif correlation shift (test)
Accuracy82.51
25
Intent GroundingMOTIF
Accuracy80.4
14
Graph ClassificationMotif (size) OOD
Accuracy55.3
14
Graph ClassificationMotif basis OOD
Accuracy73.6
14
Graph ClassificationMotif GOOD (basis)
ROC-AUC0.6977
14
Graph ClassificationMotif GOOD size
ROC AUC63.71
14
Graph ClassificationMotif OOD GraphOOD (test)
Accuracy77.43
13
Graph ClassificationMotif GraphOOD (test)
Accuracy77.96
13
Element GroundingMOTIF (test)
Grounding Accuracy78.8
13
UI Navigation / Task CompletionMoTIF (test)
Success Rate87.4
2
Showing 13 of 13 rows