Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FRANKENSTEIN

Benchmarks

Task NameDataset NameSOTA ResultTrend
Graph ClassificationFRANKENSTEIN node density F0→F2 shift
Accuracy68
30
Graph ClassificationFRANKENSTEIN node density F0→F1 shift
Accuracy72.5
30
Graph ClassificationFRANKENSTEIN node density domain shift (test)
F-score (F0→F1)69.6
15
Graph ClassificationFRANKENSTEIN F3→F2 (edge density shift)
Accuracy72.7
15
Graph ClassificationFRANKENSTEIN F2→F3 (edge density shift)
Accuracy62.2
15
Graph ClassificationFRANKENSTEIN F3→F1 (edge density shift)
Accuracy60.5
15
Graph ClassificationFRANKENSTEIN F1→F3 (edge density shift)
Accuracy60.9
15
Graph ClassificationFRANKENSTEIN F2→F1 (edge density shift)
Accuracy79.6
15
Graph ClassificationFRANKENSTEIN F1→F2 (edge density shift)
Accuracy66.2
15
Graph ClassificationFRANKENSTEIN F3→F0 (edge density shift)
Accuracy65.5
15
Graph ClassificationFRANKENSTEIN F0→F3 (edge density shift)
Accuracy61.3
15
Graph ClassificationFRANKENSTEIN F2→F0 (edge density shift)
Accuracy75.5
15
Graph ClassificationFRANKENSTEIN F0→F2 (edge density shift)
Accuracy65.8
15
Graph ClassificationFRANKENSTEIN F1→F0 (edge density shift)
Accuracy76
15
Backdoor AttackFRANKENSTEIN
Attack Success Rate (ASR)61
15
ClassificationFRANKENSTEIN F3→F2
Accuracy65.6
15
ClassificationFRANKENSTEIN F3→F1
Accuracy60.9
15
ClassificationFRANKENSTEIN F3→F0
Accuracy0.657
15
ClassificationFRANKENSTEIN F2→F3
Accuracy61.7
15
ClassificationFRANKENSTEIN F2→F1
Accuracy68.5
15
ClassificationFRANKENSTEIN F2→F0
Accuracy0.632
15
ClassificationFRANKENSTEIN F1→F3
Accuracy62.1
15
ClassificationFRANKENSTEIN F1→F2
Accuracy64.1
15
ClassificationFRANKENSTEIN F1→F0
Accuracy68
15
ClassificationFRANKENSTEIN F0→F3
Accuracy62.3
15
Showing 25 of 49 rows