Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Membership Inference on arXiv Pythia (train)
Loading...
55.4
TPR@1%FPR
AttenMIA (Perturbed)
4.856
17.978
31.1
44.222
Jan 26, 2026
TPR@1%FPR
Updated 4d ago
Evaluation Results
Method
Method
Links
TPR@1%FPR
AttenMIA (Perturbed)
Model Size=6.9b
2026.01
55.4
AttenMIA (Perturbed)
Model Size=2.8b
2026.01
50.9
AttenMIA (Perturbed)
Model Size=1.4b
2026.01
42.3
AttenMIA (Transitional)
Model Size=6.9b
2026.01
35.2
AttenMIA (Transitional)
Model Size=1.4b
2026.01
31.6
AttenMIA (Transitional)
Model Size=2.8b
2026.01
28.8
RECALL
Model Size=6.9b
2026.01
17.4
RECALL
Model Size=1.4b
2026.01
15.6
RECALL
Model Size=2.8b
2026.01
15.6
PPL attack
Model Size=1.4b
2026.01
10.4
PPL attack
Model Size=6.9b
2026.01
10.4
PPL attack
Model Size=2.8b
2026.01
6.8
Feedback
Search any
task
Search any
task