Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Code Retrieval on Adv
Loading...
48.6
MRR
SANTA (Hard Negative)
-1.424
11.563
24.55
37.537
May 31, 2023
MRR
Updated 3d ago
Evaluation Results
Method
Method
Links
MRR
SANTA (Hard Negative)
Evaluation Protocol=Fi...
2023.05
48.6
SANTA
Evaluation Protocol=Ze...
2023.05
48.1
CodeRetriever (Hard Negative)
Evaluation Protocol=Fi...
2023.05
45.1
CodeRetriever (Inbatch)
Evaluation Protocol=Fi...
2023.05
43
CodeT5
Evaluation Protocol=Fi...
2023.05
39.3
GraphCodeBERT
Evaluation Protocol=Fi...
2023.05
35.2
CodeRetriever
Evaluation Protocol=Ze...
2023.05
34.7
CodeBERT
Evaluation Protocol=Fi...
2023.05
27.2
GraphCodeBERT
Evaluation Protocol=Ze...
2023.05
0.5
Feedback
Search any
task
Search any
task