Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Membership Inference on DM Math Pythia (train)
Loading...
99.3
TPR@1%FPR
AttenMIA (Perturbed)
19.012
39.856
60.7
81.544
Jan 26, 2026
TPR@1%FPR
Updated 4d ago
Evaluation Results
Method
Method
Links
TPR@1%FPR
AttenMIA (Perturbed)
Model Size=6.9b
2026.01
99.3
AttenMIA (Perturbed)
Model Size=1.4b
2026.01
98.9
AttenMIA (Perturbed)
Model Size=2.8b
2026.01
98.8
AttenMIA (Transitional)
Model Size=2.8b
2026.01
87.8
AttenMIA (Transitional)
Model Size=1.4b
2026.01
86.7
AttenMIA (Transitional)
Model Size=6.9b
2026.01
85.6
PPL attack
Model Size=1.4b
2026.01
51.7
reference attack
Model Size=2.8b
2026.01
50.6
reference attack
Model Size=1.4b
2026.01
49.4
reference attack
Model Size=6.9b
2026.01
47.2
RECALL
Model Size=1.4b
2026.01
44.2
PPL attack
Model Size=6.9b
2026.01
42.7
PPL attack
Model Size=2.8b
2026.01
34.8
RECALL
Model Size=2.8b
2026.01
31.2
RECALL
Model Size=6.9b
2026.01
22.1
Feedback
Search any
task
Search any
task