| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| MTEB Code Retrieval Average (val) | nDCG@574 | 24 | 10d ago | ||
| FreshStack (val) | nDCG@543.8 | 24 | 10d ago | ||
| DS10K (val) | Policy Optimization | nDCG@563.8 | 24 | 10d ago | |
| MBPP (val) | nDCG@592 | 24 | 10d ago | ||
| HumanEval (val) | Policy Optimization | nDCG@598.5 | 24 | 10d ago | |
| CSN-Python Non-target Queries (test) | VenomRACG | MRR0.669 | 19 | 1mo ago | |
| CSN-Python Target Queries (test) | VenomRACG | ASR@117.64 | 18 | 1mo ago | |
| CodeSearch | SANTA | MRR47.5 | 16 | 1mo ago | |
| MTEB Code (test) | CodeR-all-1.5B | Apps Score98.1 | 12 | 25d ago | |
| MTEB Code | Gemini-Embed | APPS93.75 | 10 | 1mo ago | |
| Adv | SANTA (Hard Negative) | MRR48.6 | 9 | 1mo ago | |
| COSQA Code | ProRank | NDCG@1032.05 | 8 | 10d ago | |
| CodeSearch (test) | - | MRR- | 0 | 1mo ago |
