Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Membership Inference on PubMed Pythia (train)
Loading...
67.3
TPR@1%FPR
AttenMIA (Perturbed)
-0.612
17.019
34.65
52.281
Jan 26, 2026
TPR@1%FPR
Updated 4d ago
Evaluation Results
Method
Method
Links
TPR@1%FPR
AttenMIA (Perturbed)
Model Size=2.8b
2026.01
67.3
AttenMIA (Perturbed)
Model Size=6.9b
2026.01
63.7
AttenMIA (Perturbed)
Model Size=1.4b
2026.01
42.8
AttenMIA (Transitional)
Model Size=1.4b
2026.01
31.6
AttenMIA (Transitional)
Model Size=2.8b
2026.01
25.9
AttenMIA (Transitional)
Model Size=6.9b
2026.01
24.8
RECALL
Model Size=6.9b
2026.01
24.4
RECALL
Model Size=2.8b
2026.01
19.4
RECALL
Model Size=1.4b
2026.01
13.8
PPL attack
Model Size=1.4b
2026.01
4.8
PPL attack
Model Size=2.8b
2026.01
4.8
PPL attack
Model Size=6.9b
2026.01
2
Feedback
Search any
task
Search any
task