Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

BookMIA

Benchmarks

Task NameDataset NameSOTA ResultTrend
Pre-training data detectionBookMIA (test)
AUROC0.99
30
Membership Inference AttackBookMIA Paraphrased v1 (test)
AUROC74.5
7
Membership Inference AttackBookMIA Original v1 (test)
AUROC78.4
7
Membership InferenceBookMIA (full)
AUC0.967
6
Membership InferenceBookMIA question-answering prompts
CRM-LR AUC0.98
3
Membership InferenceBookMIA CoT continuation prompts
CRM-LR AUC0.967
3
Membership InferenceBookMIA
Coverage91
3
Showing 7 of 7 rows