Share your thoughts, 1 month free Claude Pro on usSee more

Skill Routing on Skill Routing Dataset Hard

73.3Hit@1

SR-Emb-8B + SR-Rank-8B

Updated 2mo ago

Evaluation Results

Method	Links
SR-Emb-8B + SR-Rank-8B 2026.03		73.3	78.9
SR-Emb-0.6B + SR-Rank-0.6B 2026.03		72	77.3
SR-Emb-0.6B + Qwen3-Rank-8B 2026.03		70.7	77.1
SR-Emb-0.6B + SR-Rank-8B 2026.03		70.7	77.8
SR-Emb-0.6B + Qwen3-Rank-0.6B 2026.03		69.3	75.8
Qwen3-Emb-8B + Qwen3-Rank-8B 2026.03		68	74.4
Qwen3-Emb-0.6B + Qwen3-Rank-8B 2026.03		68	72.5
SR-Emb-0.6B + GPT-5.4-mini 2026.03		65.3	-
SR-Emb-0.6B + GPT-4o-mini 2026.03		65.3	-
SR-Emb-0.6B 2026.03		64	71
Qwen3-Emb-8B 2026.03		62.7	68.7
Qwen3-Emb-8B + GPT-4o-mini 2026.03		62.7	-
Qwen3-Emb-0.6B + Qwen3-Rank-0.6B 2026.03		62.7	67.3
Qwen3-Emb-8B + GPT-5.4-mini 2026.03		56	-
Qwen3-Emb-0.6B + GPT-4o-mini 2026.03		54.7	-
Qwen3-Emb-0.6B + GPT-5.4-mini 2026.03		54.7	-
Qwen3-Emb-8B + Qwen3-Rank-0.6B 2026.03		54.7	64.7
Qwen3-Emb-0.6B 2026.03		53.3	61.8
Qwen3-Emb-0.6B + GPT-5.4-mini 2026.03		29.3	-
Qwen3-Emb-8B + GPT-5.4-mini 2026.03		26.7	-
Qwen3-Emb-0.6B + Qwen3-Rank-8B 2026.03		25.3	38.5
Qwen3-Emb-8B + Qwen3-Rank-8B 2026.03		18.7	34.8
Qwen3-Emb-0.6B + Qwen3-Rank-0.6B 2026.03		17.3	32.8
Qwen3-Emb-8B + GPT-4o-mini 2026.03		17.3	-
Qwen3-Emb-0.6B + GPT-4o-mini 2026.03		16	-
Qwen3-Emb-8B + Qwen3-Rank-0.6B 2026.03		13.3	31.8