Vulnerability Detection

Benchmarks

Dataset Name	SOTA Method	Metric
CVE-Solidity (test)	OpenInterpreter	Top 1 Hit Rate (cs)59	42	1mo ago
Reveal (test)	DISCO (MLM+CLR++NT-MLM)	Precision48.3	42	1mo ago
MoCQ (test)	Combined	True Positives (TP)292	39	4d ago
PrimeVul (test)	ReVD	F1 Score68.74	38	1mo ago
Bigvul (test)	Extension	Precision19.03	30	1mo ago
CASTLE 250-sample benchmark 1.0	VulnScout-C	CASTLE Score1,068	29	18d ago
PrimeVul Seed: PrimeVul Train (test)		Precision25.93	24	1mo ago
BigVul Seed: Devign (test)	VulScribeR	Precision11.64	24	1mo ago
PrimeVul	Qwen2.5-32B	F1 Score67.93	24	1mo ago
IEC61850	SysFuSS	Time (hours)2	19	1mo ago
Vulnerability Detection Benchmark		Pass@160.27	18	1mo ago
Dataset (test)	SemTaint	True Positives106	18	1mo ago
CodeXGLUE (test)	DISCO	Accuracy65.8	18	1mo ago
SVEN		F1 Score89.5	14	1mo ago
PrimeVul Paired (full)	SecCodePRM	PC Score93.66	13	1mo ago
SVEN (test)	ReVD	Accuracy63.72	12	1mo ago
REVEAL Chromium Linux Debian Kernel (test)	DISCO	Precision0.483	12	1mo ago
PyVul (test)	MULTIVER	Recall82.7	8	1mo ago
Security Review Benchmark 100-sample Baseline (C0 + SP0)		C0 Detection Rate96.1	8	1mo ago
RSD	ReFuzz+Cascade	Execution Time (sec)13.74	8	1mo ago
MXML		Time (hours)3	8	1mo ago
Average	Qwen3-14B	Precision65.08	8	1mo ago
R2Vul	Qwen2.5-Coder-7B-Inst	Precision100	8	1mo ago
ProSec	Qwen2.5-Coder-7B-Inst	Precision77.39	8	1mo ago
PCVE dataset		True Positives (TP)285	7	18d ago

Showing 25 of 83 rows