Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Mathematical Information Retrieval on MIRB
Loading...
85.9
MO Duplicate (nDCG@10)
Qwen3-Embedding-8B
72.484
75.967
79.45
82.933
Jun 22, 2026
MO Duplicate (nDCG@10)
mathlib Retrieval (nDCG@10)
Lean Premise (nDCG@10)
Updated 1mo ago
Evaluation Results
Method
Method
Links
MO Duplicate (nDCG@10)
mathlib Retrieval (nDCG@10)
Lean Premise (nDCG@10)
Qwen3-Embedding-8B
Parameters=8B
2026.06
85.9
55.9
13.6
Qwen3-Embedding-4B
Parameters=4B
2026.06
85.5
53.1
13.2
Octen-Embedding-8B
Parameters=8B
2026.06
85.5
65.3
14.3
MathLeap-Qwen-8B
Parameters=8B
2026.06
82.1
65.3
10.3
MathLeap-Octen-8B
Parameters=8B
2026.06
81.6
66.7
10.3
KaLM-Embedding-Gemma3-12B-2511
Parameters=12B
2026.06
77.8
50.4
13.3
harrier-oss-v1-0.6B
Parameters=0.6B
2026.06
76.2
34.5
8.7
llama-embed-nemotron-8b
Parameters=8b
2026.06
73
26.7
5
Feedback
Search any
task
Search any
task