Share your thoughts, 1 month free Claude Pro on usSee more

Compositional Reasoning on Winoground

41.25Group Score

Qwen2.5-VL-7B + SSL-R1

Updated 18d ago

Evaluation Results

Method
Qwen2.5-VL-7B + SSL-R1 2026.04	41.25	-	-	-
Qwen2.5-VL-7B + Visual Jigsaw 2026.04	39.25	-	-	-
VL-Cogito-7B 2026.04	38.25	-	-	-
Qwen2.5-VL-7B 2026.04	37	-	-	-
ThinkLite-VL-7B 2026.04	35.25	-	-	-
LLaVA-Critic-R1-7B 2026.04	34.75	-	-	-
Qwen2.5-VL-3B + SSL-R1 2026.04	29.25	-	-	-
Qwen2.5-VL-3B 2026.04	27.75	-	-	-
Qwen2.5-VL-3B + Visual Jigsaw 2026.04	27.25	-	-	-
SAIL-L-NV2 2024.12	15	40.25	18.75	-
SAIL-L-NV2 2024.12	13.2	37.75	18.25	-
SAIL-B-NV2 2024.12	13	35	17.25	-
SAIL-B-GTE 2024.12	9.5	31	11.5	-
CLIP 2026.06	9.4	31.6	11.1	-
SAIL-L-GTE 2024.12	9.25	33.25	13	-
SAIL-L-GTE 2024.12	8.75	34	13.25	-
CLIP-L 2024.12	8.75	30.5	11.5	-
MACCO-CLIP 2026.06	8.2	32.2	11.1	-
CLIP-B 2024.12	7.75	25.7	11.5	-
DreamLIP 2024.12	7.25	26	10	-
TripletCLIP++ 2024.11	6.75	22.25	9.5	-
LaCLIP 2024.11	6.25	26.25	8	-
LaCLIP 2024.11	6	24.75	9.25	-
CLIP-FT 2026.06	5.9	32.2	8.8	-
NegCLIP++ 2024.11	5.5	23.5	7.75	-
ShareLock+ 2024.12	5.3	26.3	12.8	-
NegCLIP 2024.11	5.25	21	8.5	-
LiT 2024.12	4.8	24.3	6.5	-
TripletCLIP 2024.11	4.25	24.25	6.25	-
NegCLIP 2024.11	4.25	18.25	6.5	-
TripletCLIP 2024.11	4.25	23.25	6.25	-
NegCLIP++ 2024.11	3.25	22	5.5	-
LaCLIP + HN 2024.11	3	23.25	4.25	-
CLIP 2025.09	-	-	-	17.2
SigLIP 2025.09	-	-	-	18.6
DACLLM 2025.09	-	-	-	12.6
DCIP1 2025.09	-	-	-	12.1
CE-CLIP 2025.09	-	-	-	12.3
NegCLIP 2025.09	-	-	-	16.4
LongCLIP 2025.09	-	-	-	14.7
DreamLIP 2025.09	-	-	-	18
LSS 2025.09	-	-	-	17.5
TinyLLaVA 2026.07	-	-	-	70.1
TinyLLaVA 2026.07	-	-	-	62.6
KD 2026.07	-	-	-	61.5
LLaVA-KD 2026.07	-	-	-	60.9
CompoDistill 2026.07	-	-	-	62.2
TRAG 2026.07	-	-	-	67.2
TinyLLaVA 2026.07	-	-	-	50.2
KD 2026.07	-	-	-	52.1
LLaVA-KD 2026.07	-	-	-	51.7
CompoDistill 2026.07	-	-	-	56.6
TRAG 2026.07	-	-	-	57.3
TinyLLaVA 2026.07	-	-	-	75
TinyLLaVA 2026.07	-	-	-	70.3
TRAG 2026.07	-	-	-	73.9
TinyLLaVA 2026.07	-	-	-	57
TRAG 2026.07	-	-	-	59.6