Our new X account is live! Follow @wizwand_team for updates

Image Retrieval on MS-COCO 5K (test)

67.2R@1

CoCa

Updated 2d ago

Evaluation Results

Method
CoCa 2023.01	67.2	87.7	92.8
X-FMbase 2023.01	67	87.2	92.4
X2-VLMbase 2023.01	66.2	87.1	92.2
mPLUG-2 2023.02	65.7	87.1	92.6
mPLUG-2Base 2023.02	65.3	86.9	92.4
VLMO-Large++ 2021.11	65.2	86.5	92.2
BLIP 2023.02	65.1	86.3	91.8
BLIP 2023.05	65.1	86.3	91.8
OmniVL 2022.09	64.8	86.1	91.6
X-FMbase 2023.01	64.7	86.1	91.6
BLIP 2022.06	64.3	85.7	91.5
X-VLM + EPIC 2022.11	64.1	86.1	91.6
X-VLM + EPIC 2022.11	64.1	85.9	91.8
X-VLM 2021.11	63.4	85.8	91.5
X-VLM 2022.11	63.3	85.6	91.4
Florence-Huge 2021.11	63.2	85.7	-
Florence 2023.02	63.2	85.7	-
Florence 2022.09	63.2	85.7	-
BLIP 2022.06	63.1	85.3	91.1
X-VLM 2021.11	63.1	85.7	91.6
X-VLM 2023.01	63.1	85.7	91.6
BLIP 2022.09	63.1	85.3	91.1
ALBEF + EPIC 2022.11	62.9	85.4	91.3
X-VLM 2022.11	62.7	85.6	91.4
X2-VLMbase 2023.01	62.7	84.7	90.7
METER + EPIC 2022.11	62.5	85.4	91.9
VL-BEIT 2023.01	61.5	-	-
ALBEF 2022.11	61.3	84.3	90.6
METER + EPIC 2022.11	61.2	85.2	91.6
X-FMbase 2023.01	61.1	84.5	90.6
BEIT-3 2023.01	61.1	84.5	90.6
RaSa 2023.05	61	84.49	90.83
CCLM_base 2022.06	60.89	-	-
ALBEF 2021.07	60.7	84.3	90.5
ALBEF 2022.06	60.7	84.3	90.5
ALBEF 2021.11	60.7	84.3	90.5
ALBEF 2023.02	60.7	84.3	90.5
ALBEF 2022.09	60.7	84.3	90.5
VLMO-Large 2021.11	60.6	84.4	91
VLMo 2023.02	60.6	84.4	91
AlignCMSS 2023.09	60.4	84.3	90.7
ALBEF 2023.05	60.31	84.22	90.51
ALIGN 2021.07	59.9	83.3	89.8
ALIGN 2022.02	59.9	83.3	89.8
ALIGN-Large 2021.11	59.9	83.3	89.8
ALIGN 2022.06	59.9	83.3	89.8
ALIGN 2021.11	59.9	83.3	89.8
ALIGN 2022.07	59.9	83.3	89.8
ALIGN 2023.02	59.9	83.3	89.8
ALIGN 2023.05	59.9	83.3	89.8
ALIGN 2022.09	59.9	83.3	89.8
METER 2022.11	59.8	84.2	90.8
SINGULARITY 2022.06	59.6	83.4	90
X-FMbase 2023.01	59.4	83.6	90
METER 2022.11	59.2	84	90.8
Triple Contrastive Learning (TCL) 2022.02	59	83.2	89.9
OSCAR+ w/ VINVL 2021.01	58.8	83.5	90.3
VinVL-Large 2021.11	58.8	83.5	90.3
VinVL_large 2021.11	58.8	83.5	90.3
ALBEF + EPIC 2022.11	58.6	82.7	89.3
OmniVL 2023.01	58.5	82.6	89.5
OmniVL 2022.09	58.5	82.6	89.5
X2-VLMbase 2023.01	58.3	84.7	91
OSCAR+ w/ VINVL 2021.01	58.1	83.2	90.1
VinVL-Base 2021.02	58.1	83.2	90.1
VinVL (Base) 2022.07	58.1	83.2	90.1
VinVL_base 2022.06	58.1	-	-
VinVL 2023.09	58.1	83.2	90.1
Knowledge-CLIP 2022.10	57.6	83.9	90.4
OSCAR 2020.04	57.5	82.8	89.8
OSCAR 2020.04	57.5	82.8	89.8
Oscar 2021.02	57.5	82.8	89.8
Oscar 2021.01	57.5	82.8	89.8
OSCAR 2022.10	57.5	82.8	89.8
X-VLM 2022.11	57.5	83.3	90
X-VLM + EPIC 2022.11	57.5	83.3	90
Oscar 2023.05	57.5	82.8	89.8
X-VLM 2022.11	57.3	83.4	90.2
X-VLM + EPIC 2022.11	57.3	83.4	90.2
VLMO-Base 2021.11	57.2	82.6	89.8
VLMbase 2023.01	57.2	82.6	89.8
VLMO 2022.09	57.2	82.6	89.8
METER-CLIP 2021.11	57.1	82.7	90.1
METER 2022.09	57.1	82.7	90.1
X-VLM 2022.11	56.9	83	89.9
X-VLM 2022.11	56.9	83	89.9
ALBEF 2021.07	56.8	81.5	89.2
ALBEF 2022.02	56.8	81.5	89.2
ALBEF-Base 2021.11	56.8	81.5	89.2
ALBEF 2022.06	56.8	81.5	89.2
ALBEF 2021.11	56.8	81.5	89.2
ALBEF 2022.06	56.8	-	-
ALBEF 2023.01	56.8	81.5	89.2
ALBEF 2022.11	56.4	81.8	88.9
X-VLM 2021.11	56.1	83	89.8
X-VLM 2021.11	55.6	82.7	90
X-VLM 2023.01	55.6	82.7	90
X-VLM 2022.11	55.3	82.5	89.7
X-VLM 2022.11	55.3	82.5	89.7
X2-VLMbase 2023.01	55.2	82.2	89.3

Showing 100 of 217 rows