Share your thoughts, 1 month free Claude Pro on usSee more

Pre-training data detection on MIMIR

0.69AUROC (Wikipedia)

Min-k++

Updated 2mo ago

Evaluation Results

Method	Links
Min-k++ 2026.03		0.69	0.86	0.56	0.6	0.7	0.75	0.6	0.67
Min-k 2026.03		0.68	0.89	0.57	0.81	0.79	0.93	0.62	0.73
Min-k 2026.03		0.68	0.9	0.56	0.74	0.78	0.92	0.62	0.75
Min-k++ 2026.03		0.68	0.86	0.55	0.71	0.64	0.79	0.57	0.63
FSD 2026.03		0.67	0.8	0.55	0.71	0.78	0.85	0.6	0.66
Min-k 2026.03		0.66	0.88	0.56	0.52	0.78	0.93	0.65	0.71
ZLib 2026.03		0.65	0.91	0.55	0.78	0.78	0.81	0.6	0.67
ZLib 2026.03		0.65	0.91	0.55	0.73	0.77	0.81	0.6	0.72
Min-k 2026.03		0.65	0.76	0.56	0.8	0.65	0.92	0.59	0.69
Min-k++ 2026.03		0.65	0.84	0.54	0.51	0.6	0.77	0.53	0.6
FSD 2026.03		0.65	0.77	0.55	0.63	0.7	0.74	0.56	0.62
GDS 2026.03		0.65	0.88	0.59	0.84	0.78	0.94	0.6	0.74
GDS 2026.03		0.65	0.92	0.57	0.79	0.78	0.95	0.57	0.76
GDS 2026.03		0.64	0.92	0.59	0.85	0.79	0.95	0.6	0.75
GDS 2026.03		0.64	0.91	0.59	0.82	0.77	0.95	0.58	0.7
Min-k 2026.03		0.63	0.83	0.52	0.79	0.7	0.32	0.59	0.6
GDS 2026.03		0.63	0.9	0.59	0.84	0.78	0.95	0.58	0.73
ZLib 2026.03		0.62	0.9	0.55	0.52	0.77	0.82	0.68	0.65
FSD 2026.03		0.61	0.77	0.55	0.52	0.72	0.58	0.61	0.61
Min-k++ 2026.03		0.6	0.56	0.54	0.72	0.53	0.67	0.51	0.56
FSD 2026.03		0.6	0.62	0.54	0.79	0.55	0.6	0.57	0.59
FSD 2026.03		0.6	0.72	0.52	0.56	0.52	0.53	0.51	0.55
ZLib 2026.03		0.59	0.79	0.55	0.78	0.68	0.8	0.58	0.63
ZLib 2026.03		0.58	0.86	0.52	0.77	0.71	0.23	0.58	0.58
PPL 2026.03		0.57	0.79	0.57	0.78	0.79	0.79	0.62	0.66
PPL 2026.03		0.56	0.78	0.56	0.52	0.78	0.78	0.65	0.64
PPL 2026.03		0.56	0.78	0.56	0.78	0.65	0.65	0.59	0.62
PPL 2026.03		0.56	0.9	0.56	0.78	0.78	0.91	0.62	0.73
PPL 2026.03		0.56	0.83	0.52	0.72	0.7	0.31	0.59	0.59
Min-k++ 2026.03		0.56	0.73	0.51	0.7	0.57	0.22	0.53	0.53