Share your thoughts, 1 month free Claude Pro on usSee more

Skill Routing on Skill Routing Dataset Easy (Hit@1, MRR)

78.7Hit@1

SR-Emb-0.6B + SR-Rank-8B

Updated 2mo ago

Evaluation Results

Method	Links
SR-Emb-0.6B + SR-Rank-8B 2026.03		78.7	83.1
SR-Emb-8B + SR-Rank-8B 2026.03		78.7	82.7
SR-Emb-0.6B + SR-Rank-0.6B 2026.03		76	80.9
SR-Emb-0.6B + Qwen3-Rank-0.6B 2026.03		72	78
SR-Emb-0.6B + Qwen3-Rank-8B 2026.03		72	78.1
Qwen3-Emb-0.6B + Qwen3-Rank-8B 2026.03		69.3	74.1
SR-Emb-0.6B + GPT-4o-mini 2026.03		69.3	-
Qwen3-Emb-8B + Qwen3-Rank-8B 2026.03		68	74.5
SR-Emb-0.6B 2026.03		66.7	73.5
Qwen3-Emb-8B + GPT-4o-mini 2026.03		66.7	-
SR-Emb-0.6B + GPT-5.4-mini 2026.03		66.7	-
Qwen3-Emb-8B 2026.03		65.3	70.9
Qwen3-Emb-0.6B + Qwen3-Rank-0.6B 2026.03		65.3	69.5
Qwen3-Emb-8B + GPT-5.4-mini 2026.03		62.7	-
Qwen3-Emb-8B + Qwen3-Rank-0.6B 2026.03		61.3	69.7
Qwen3-Emb-0.6B 2026.03		58.7	65.8
Qwen3-Emb-0.6B + GPT-5.4-mini 2026.03		57.3	-
Qwen3-Emb-0.6B + GPT-4o-mini 2026.03		56	-
Qwen3-Emb-0.6B + GPT-5.4-mini 2026.03		37.3	-
Qwen3-Emb-0.6B + Qwen3-Rank-0.6B 2026.03		36	45.5
Qwen3-Emb-0.6B + Qwen3-Rank-8B 2026.03		36	46.5
Qwen3-Emb-8B + GPT-5.4-mini 2026.03		34.7	-
Qwen3-Emb-8B + Qwen3-Rank-8B 2026.03		29.3	43.7
Qwen3-Emb-8B + Qwen3-Rank-0.6B 2026.03		29.3	45.1
Qwen3-Emb-0.6B + GPT-4o-mini 2026.03		25.3	-
Qwen3-Emb-8B + GPT-4o-mini 2026.03		21.3	-