AI-generated text detection

Benchmarks

Dataset Name	SOTA Method	Metric
XSum Generated by Claude3 (test)	DPIC	AUROC100	60	1mo ago
XSum Generated by GPT-4 (test)	DPIC	AUROC0.9996	60	1mo ago
XSum Generated by ChatGPT (test)	DPIC	AUROC1	60	1mo ago
Long-form QA 3K generations corpus	Watermark	Detection Accuracy (1% FPR)100	42	1mo ago
RAID (test)	Binoculars	TP @ 20% Error Threshold78.4	42	1mo ago
AcademicResearch	Learn-to-Distance	AUC99.5	36	1mo ago
Cross-genre (test)	Log-Likelihood	OA97.5	32	1mo ago
mixed-source AI -> Human GPT-2, GPT-Neo, GPT-J, LLaMa, GPT-3	SeqXGPT	Overall Accuracy96.5	26	1mo ago
TravelTourism	Learn-to-Distance	AUC99.8	24	1mo ago
TechnicalWriting	Learn-to-Distance	AUC100	24	1mo ago
Sports	Learn-to-Distance	AUC0.965	24	1mo ago
Religious	Learn-to-Distance	AUC99.6	24	1mo ago
ProductReview	Learn-to-Distance	AUC99.5	24	1mo ago
PersonalCommunication	Learn-to-Distance	AUC0.95	24	1mo ago
OnlineContent	Learn-to-Distance	AUC97.3	24	1mo ago
NewsArticle	Learn-to-Distance	AUC99.9	24	1mo ago
MedicalText	Binoculars	AUC0.985	24	1mo ago
LiteratureCreativeWriting	Learn-to-Distance	AUC100	24	1mo ago
LegalDocument	Learn-to-Distance	AUC1	24	1mo ago
GovernmentPublic	ImBD	AUC99.5	24	1mo ago
FoodCusine	ImBD	AUC0.992	24	1mo ago
Finance	Learn-to-Distance	AUC0.998	24	1mo ago
Environmental	FDGPT	AUC99.8	24	1mo ago
Entertainment	FDGPT	AUC1	24	1mo ago
EducationMaterial	FDGPT	AUC1	24	1mo ago

Showing 25 of 139 rows