Attack Detection

Benchmarks

Dataset Name	SOTA Method	Metric
SWaT Malicious Controller Output Injection (test)	SRLR	F1 Score99.8	20	1mo ago
CIFAR-100 (test)	FS	BIM AUC89	16	1mo ago
SWaT Controller Configuration Tampering Attack (test)	SRLR	F199.55	10	1mo ago
Harmful Attacks 105K sample set	LlamaGuard	Detection Rate97.4	8	1mo ago
DARPA THEIA E5	Threatrace	TP66	7	1mo ago
DARPA CADETS E5	MAGIC	TP123	7	1mo ago
DARPA THEIA E3	MAGIC	True Positives (TP)115	7	1mo ago
DARPA E3 CADETS	MAGIC	True Positives (TP)63	7	1mo ago
THEIA Kairos	Auto-Prov	AUC-ROC0.858	6	1mo ago
THEIA OCR-APT	Auto-Prov	AUC-ROC96.2	6	1mo ago
THEIA MAGIC	Auto-Prov	AUC-ROC86.9	6	1mo ago
THEIA Flash	Auto-Prov	AUC-ROC90.1	6	1mo ago
Attack Detection Evaluation Set	traceguard	Safety (Th=0.3)100	5	12d ago
VeReMi Extension	FedSecureFormer	Recall (A(1))95.14	5	1mo ago
Benign Samples 105K sample set		Benign FPR40	4	1mo ago
Mixed Attacks 105K sample set	LogReg (Ours)	Detection Rate77	4	1mo ago
Extraction Attacks 105K sample set		Detection Rate100	4	1mo ago
Jailbreak Attacks 105K sample set	LogReg (Ours)	Detection Rate68	4	1mo ago
BATADAL (val)	XGB + RF	AUC97.23	4	1mo ago
HotpotQA and FEVER	RSP-M	AUROC0.94	3	1mo ago
Agent Traces IID	structural tokenization	ROC AUC0.93	3	1mo ago
Agent Traces (Held-out)	gated multi-view fusion	ROC-AUC (Social engineering)0.89	3	1mo ago
Attack Traces OOD Average	Struct	AUC0.83	3	1mo ago
Attack Traces (Unknown)	Struct	AUC0.97	3	1mo ago
Attack Traces Tool hijack	Struct	AUC0.85	3	1mo ago

Showing 25 of 35 rows