Share your thoughts, 1 month free Claude Pro on usSee more

Composed Image Retrieval on CIRCO (test)

43.4mAP@10

MMRet-MLLM

Updated 1mo ago

Evaluation Results

Method
MMRet-MLLM 2024.12	43.4	42.2	46.5	47.6
Paracosm 2026.01	40.86	39.82	43.96	45.05
MMRet-Large 2024.12	40.2	39.2	42.9	44
WISER 2026.02	38.14	36.53	40.46	41.26
WISER 2026.02	36.3	35.1	38.46	39.15
MagicLens-L 2024.03	35.4	34.1	38.1	39.2
MagicLens-L 2024.12	35.4	34.1	38.1	39.2
MMRet-Base 2024.12	35	34.3	37.6	38.7
CVSI 2026.01	34.96	33.51	37.86	38.98
IP-CIR 2024.12	34.3	32.8	36.9	38
IP-CIR 2026.02	34.26	32.75	36.86	38.03
WISER 2026.02	33.18	32.23	34.82	35.35
CoTMR 2026.02	32.72	32.23	35.6	36.83
LDRE 2026.01	32.24	31.12	34.95	36.03
LDRE 2026.01	32.24	31.12	34.95	36.03
LDRE 2026.02	32.24	31.12	34.95	36.03
LDRE 2024.12	32.2	31.1	35	36
MagicLens-B 2024.03	32	30.8	34.5	35.6
MagicLens-B 2024.12	32	30.8	34.5	35.6
OSrCIR 2024.12	31.14	30.47	35.03	36.59
OSrCIR w/ GPT-4o 2026.01	31.14	30.47	35.03	36.59
OSrCIR 2026.02	31.14	30.47	35.03	36.59
MagicLens-L 2024.03	30.8	29.6	33.4	34.4
MagicLens-L 2024.12	30.8	29.6	33.4	34.4
CoVR-BLIP-2 2023.08	29.55	28.29	32.18	33.26
ImageScope 2025.03	29.23	28.36	30.81	31.88
TFCIR 2023.08	28.25	26.52	31.23	31.99
CVSI 2026.01	28.24	-	-	-
CVSI 2026.01	28.24	26.89	30.79	31.89
CoTMR 2026.02	28.22	27.61	30.61	31.7
CIReVL* 2024.12	28.01	27.12	30.35	31.39
CIREVL 2024.03	27.6	26.8	30	31
CIReVL 2024.12	27.6	26.8	30	31
CIReVL 2024.12	27.59	26.77	29.96	31.03
CIReVL 2023.08	27.59	26.77	29.96	31.03
CIReVL 2026.01	27.59	26.77	29.96	31.03
CIReVL 2026.01	27.59	26.77	29.96	31.03
CIReVL 2023.10	27.59	26.77	29.96	31.03
CIReVL 2026.02	27.59	26.77	29.96	31.03
IP-CIR 2026.02	27.41	26.43	29.87	31.07
OSrCIR w/ GPT-4o 2026.01	27.18	25.62	29.66	30.73
GRB+LCR 2023.08	26.93	25.38	29.82	30.74
X-Aligner 2026.01	26.86	25.72	29.16	30.2
X-Aligner 2026.01	26.49	25.11	28.83	29.98
ImageScope 2025.03	25.82	25.26	27.15	28.11
ImageScope 2025.03	25.82	25.39	27.07	27.98
OSrCIR 2024.12	25.33	23.87	27.84	28.97
OSrCIR 2025.12	25.33	23.87	27.84	28.97
OSrCIR 2026.02	25.33	23.87	27.84	28.97
AutoCIR 2026.02	25.14	24.05	27.35	28.36
CIReVL + SoFT 2025.12	24.72	23.9	26.94	27.93
CoVR-BLIP-2 2023.08	24.66	23.5	27.05	28.04
LDRE 2025.03	24.03	23.35	26.44	27.5
LDRE 2026.01	24.03	-	-	-
LDRE 2026.01	24.03	23.35	26.44	27.5
LDRE 2025.12	24.03	23.35	26.44	27.5
LDRE 2026.02	24.03	23.35	26.44	27.5
MagicLens-B 2024.03	23.8	23.1	25.8	26.7
MagicLens-B 2024.12	23.8	23.1	25.8	26.7
CoTMR 2026.02	22.78	22.23	24.68	25.74
CVSI 2026.01	22.47	21.67	24.46	25.44
CoVR-BLIP 2023.08	22.33	21.43	24.47	25.48
CoVR-BLIP 2026.01	22.33	21.43	24.47	25.48
ImageScope 2025.03	22.19	22.36	23.03	23.83
CIG + LinCIR 2026.01	21.9	20.64	24.04	25.2
LinCIR 2023.12	21.01	19.71	23.13	24.18
LinCIR 2024.12	21.01	19.71	23.13	24.18
LinCIR (ViT-G) 2023.08	21.01	19.71	23.13	24.18
LinCIR 2026.01	21.01	19.71	23.13	24.18
LinCIR 2026.01	21.01	19.71	23.13	24.18
LinCIR 2026.02	21.01	19.71	23.13	24.18
LinCIR 2024.03	21	19.7	23.1	24.2
LinCIR 2024.12	21	19.7	23.1	24.2
CIReVL + SoFT 2025.12	20.04	19.21	21.86	22.75
HyCIR 2025.03	19.67	18.91	21.58	22.49
AutoCIR 2026.02	19.41	18.82	21.38	22.32
CIReVL* 2024.12	19.32	18.92	21.15	22.14
OSrCIR 2024.12	19.17	18.04	20.94	21.85
OSrCIR 2025.12	19.17	18.04	20.94	21.85
OSrCIR 2026.02	19.17	18.04	20.94	21.85
CIReVL 2024.12	19.01	18.57	20.89	21.8
CIREVL 2025.03	19.01	18.57	20.89	21.8
CIReVL 2026.01	19.01	18.57	20.89	21.8
CIReVL 2026.01	19.01	-	-	-
CIReVL 2026.01	19.01	18.57	20.89	21.8
CIReVL 2025.12	19.01	18.57	20.89	21.8
CIReVL 2023.10	19.01	18.57	20.89	21.8
CIReVL 2026.02	19.01	18.57	20.89	21.8
CIREVL 2024.03	19	18.6	20.9	21.8
CIReVL 2024.12	19	18.6	20.9	21.8
LinCIR 2023.12	18.52	17.6	20.46	21.39
LinCIR 2024.03	18.5	17.6	20.5	21.4
LinCIR 2024.12	18.5	17.6	20.5	21.4
LDRE 2025.03	18.32	17.96	20.21	21.11
LDRE 2026.01	18.32	17.96	20.21	21.11
LDRE 2025.12	18.32	17.96	20.21	21.11
LDRE 2026.02	18.32	17.96	20.21	21.11
LDRE 2024.12	18.3	18	20.2	21.1
CompoDiff 2023.03	17.71	15.33	19.45	21.01
CompoDiff 2023.03	17.71	15.33	19.45	21.01

Showing 100 of 263 rows