Share your thoughts, 1 month free Claude Pro on usSee more

Visual Document Retrieval on ViDoRe V1+V2 (test)

93.8ArXiv NDCG@5

Sauerkraut-8b

Updated 1mo ago

Evaluation Results

Method	Links
Sauerkraut-8b 2026.06		93.8	64.7	94.5	90.4	98.6	96.5	96.8	99.3	92.2	84	64.9	58.4	70.8	57.6	91.1	62.9	83
Nemotron-colembed-8b-v2 2026.06		93.1	68.1	94.6	93.3	100	97.9	98.9	99.6	97.7	83.4	67	59	73.2	60.4	92.7	64.9	84.7
Argus-9B 2026.06		92.3	68.1	94.3	93.6	99.6	97.3	98.9	99.6	97.5	85.5	66.2	67.6	79.1	63.8	92.7	69.2	86
Nemotron-colembed-4b-v2 2026.06		92	67.4	93.3	92.3	99.3	96.2	98	98.5	98.1	81.2	64	62.4	71.4	57.7	91.6	63.9	83.7
Sauerkraut-4b 2026.06		91.8	67	94.2	90.5	99.6	96.5	96.2	100	89.5	82.7	60	58.8	69.2	56	90.8	61	82.3
Ops-Colqwen3-4B 2026.06		91.8	66.5	94	90.8	99.6	97.3	98	99.6	93.6	82.4	64.9	65.6	78.6	61.9	91.4	67.8	84.6
Argus-4B 2026.06		91	67.7	94.6	94.7	99.6	97.9	97.8	99.6	95.3	84.8	64.4	62.2	69.9	59.8	92.3	64.1	84.2
Argus-2B 2026.06		90.3	67.5	95	91.3	99.6	97.3	97.3	99.3	93.4	84	65	59.9	69.4	51.9	91.5	61.5	82.9
ColQwen2.5 2026.06		88.9	63.6	92.5	87.9	99.6	96.1	95.8	98	90.8	82.1	59.2	58.3	66.4	53.3	89.5	59.3	80.9
Nemotron-colembed-3b-v1 2026.06		88.4	66.2	94.9	90.7	99.6	96.6	97.8	99.3	95.9	80.6	64.3	58.6	75.4	55.9	91	63.5	83.2
ColNomic-7b 2026.06		88.3	60.1	92.2	89.3	98.8	96.3	95.9	99.3	96	81.1	63.4	54.8	68.7	56.2	89.7	60.8	81.5
ColNomic-3b 2026.06		88.1	61.3	92.8	90.1	96.3	97.4	96.6	98.3	94.4	83.2	62.5	49.2	57	53.3	89.9	55.5	80
ColQwen2 v1.0 2026.06		88	61.5	92.5	89.9	99	95.9	95.5	98.8	89	82.2	56.3	52.5	60.4	50.6	89.2	55	79.4
ColPali v1.3 2026.06		83.3	58.4	85.5	77.3	97.4	94.6	96.1	97.4	86.7	70.8	54.6	54.9	58.5	48.6	84.8	54.2	76
ColSmol-500M 2026.06		74.9	58	87.2	66.8	98.4	94.6	94.7	98	74.7	77.5	44.9	40.4	52.4	36.4	82.5	43.5	71.4