Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Vulnerability Detection & Localization on PrimeVul (test)
Loading...
11.7
Top-1 Accuracy
ANVIL
3.692
5.771
7.85
9.929
Aug 28, 2024
Top-1 Accuracy
Top-3 Accuracy
Top-5 Accuracy
Mean False Rank (MFR)
Normalized MFR (N-MFR)
ROC-AUC
Updated 26d ago
Evaluation Results
Method
Method
Links
Top-1 Accuracy
Top-3 Accuracy
Top-5 Accuracy
Mean False Rank (MFR)
Normalized MFR (N-MFR)
ROC-AUC
ANVIL
Dataset=N/A, Backbone=...
2024.08
11.7
31.3
41.4
25
0.18
61.8
LLMAO
Dataset=BigVul
2024.08
9.2
17.3
26.2
49.3
0.39
51.8
LineVD
Dataset=BigVul
2024.08
9.2
15.4
23.1
38
0.3
49.6
LLMAO
Dataset=Devign
2024.08
4.4
14
22.5
50.7
0.4
50.7
LineVul
Dataset=BigVul, Backbo...
2024.08
4
17
30
17.6
0.71
49.6
Feedback
Search any
task
Search any
task
