Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DetectRL

Benchmarks

Task NameDataset NameSOTA ResultTrend
AI-generated text detectionDetectRL Multi-Domain
AUROC96.19
27
AI-generated text detectionDetectRL Multi-LLM
AUROC97.17
27
AI-generated text detection and calibrationDetectRL Prompt attack
AUC@1%80.9
20
LLM-generated text detectionDetectRL Out-of-Domain Multi-Topic 1.0 (test)
Average Detection Score91.1
18
Machine-generated Text DetectionDetectRL Mixing Attack
AUROC (%)99.83
16
Machine-generated Text DetectionDetectRL Perturbation Attack
AUROC99.99
16
Machine-generated Text DetectionDetectRL Paraphrase Attack
AUROC99.98
16
Machine-generated Text DetectionDetectRL Prompt Attack
AUROC99.96
16
Machine-generated Text DetectionDetectRL Direct Attack
AUROC99.99
16
Machine-generated Text DetectionDetectRL Llama-2
AUROC99.99
16
Machine-generated Text DetectionDetectRL PaLM-2
AUROC99.94
16
Machine-generated Text DetectionDetectRL Claude
AUROC0.9998
16
Machine-generated Text DetectionDetectRL GPT-3.5
AUROC99.99
16
LLM-generated text detectionDetectRL Out-of-Domain Multi-LLM 1.0 (test)
Average Performance Score90.6
16
AI-generated text detectionDetectRL Multi-Attack
F1 Score (Prompt)99.56
15
Machine-generated Text DetectionDetectRL Review
AUROC99.97
15
Machine-generated Text DetectionDetectRL Writing
AUROC99.99
15
Machine-generated Text DetectionDetectRL XSum
AUROC99.99
15
Machine-generated Text DetectionDetectRL ArXiv
AUROC100
15
Machine-generated text detectionDetectRL Multi-LLM (in-domain)
Score (GPT-3.5)99.7
14
Machine-generated text detectionDetectRL Multi-Topic (in-domain)
arXiv Score1
14
LLM-generated text detectionDetectRL
AUROC (Multi-Domain)97.97
12
Binary AIGC DetectionDetectRL
Accuracy97.2
12
Machine-generated text detectionDetectRL Training Text: Llama-2-70b (test)
Detection Score (Llama-2-70b)90.2
12
Machine-Generated Text DetectionDetectRL (test)
Detection Score (Llama-2-70b)50.56
12
Showing 25 of 42 rows