Share your thoughts, 1 month free Claude Pro on usSee more

Skill Retrieval on BigCodeBench

73.2nDCG@1

Qwen3-32B

Updated 1mo ago

Evaluation Results

Method	Links
Qwen3-32B 2026.04		73.2	74.1
Mistral3.1-24B 2026.04		72	72.9
Llama-3.3-70B 2026.04		71.1	72.1
Qwen3-235B 2026.04		70.7	73.1
Qwen3-4B 2026.04		68.4	66.6
BM25 2026.04		61.7	55.4
Hybrid 2026.04		61.7	59.9
Llama-3.1-8B 2026.04		59.2	61.6
TF-IDF 2026.04		55.2	52
BGE 2026.04		54	53.6
Contriever 2026.04		49.2	47.9