Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Membership Inference Attack on WikiMIA (TPR@5%FPR)
Loading...
19.6
TPR@5%FPR
Probe Attack (Probe w. Synthetic Data)
8.68
11.515
14.35
17.185
Jun 3, 2024
TPR@5%FPR
Updated 4d ago
Evaluation Results
Method
Method
Links
TPR@5%FPR
Probe Attack (Probe w. Synthetic Data)
Target Model=Pythia
2024.06
19.6
Zlib Compression
Target Model=Pythia
2024.06
17.3
Min-K% Prob
Target Model=Pythia
2024.06
16.9
Probe Attack (Probe w. Real Data)
Target Model=Pythia
2024.06
16.7
Probe Attack (Probe w. Real Data)
Target Model=OPT
2024.06
15.4
Min-K% Prob
Target Model=OPT
2024.06
15
Zlib Compression
Target Model=OPT
2024.06
14.4
Neighbor Attack
Target Model=Pythia
2024.06
14
Smaller Model
Target Model=Pythia
2024.06
14
Loss Attack
Target Model=Pythia
2024.06
13.7
Neighbor Attack
Target Model=OPT
2024.06
13.4
Loss Attack
Target Model=OPT
2024.06
11.4
Smaller Model
Target Model=OPT
2024.06
10.5
Probe Attack (Probe w. Synthetic Data)
Target Model=OPT
2024.06
10.5
Lowercased Text
Target Model=Pythia
2024.06
10.1
Lowercased Text
Target Model=OPT
2024.06
9.1
Feedback
Search any
task
Search any
task