Share your thoughts, 1 month free Claude Pro on usSee more

Vulnerability Detection on Smart Contract Audit Dataset

98.29Precision

Ours (rsLoRA + Voting)

Updated 1mo ago

Evaluation Results

Method	Links
Ours (rsLoRA + Voting) 2026.06		98.29	98.22	98.24	98.25
rsLoRA (w/o voting) 2026.06		97.55	97.53	97.54	97.54
CodeLlama-13B 2026.06		97.01	96.78	96.83	96.84
LoRA (w/o voting) 2026.06		96.94	96.8	96.84	96.84
Qwen2.5-14B 2026.06		96.88	96.81	96.84	96.84
CodeLlama-34B 2026.06		96.7	96.42	96.48	96.49
Codestral-22B 2026.06		96.56	96.45	96.49	96.49
CodeGemma-7B 2026.06		96.39	96.06	96.13	96.14
DeepSeek-33B 2026.06		96.3	96.08	96.13	96.14
LoRA (with voting) 2026.06		95.09	95.12	95.09	95.09
Qwen2.5-32B 2026.06		94.89	94.67	94.72	94.74
DeepSeek-7B 2026.06		90.73	90.44	90.5	90.53
CodeLlama-34B 2026.06		75.36	53.77	40.66	52.63
Qwen2.5-32B 2026.06		74.98	74.26	73.89	74.04
CodeGemma-7B 2026.06		64.53	62.57	60.95	62.11
CodeLlama-13B 2026.06		62.01	55.31	47.53	54.39
DeepSeek-7B 2026.06		56.08	54.64	51.43	54.04
Qwen2.5-14B 2026.06		52.55	50.96	42.39	51.93
Codestral-22B 2026.06		49.72	49.82	45.57	50.53
DeepSeek-33B 2026.06		25.61	50	33.87	51.23