Our new X account is live! Follow @wizwand_team for updates

Compositional Generalization on Evaluation Dataset Unseen (Fold 3)

0.4022Score

Qwen2.5-7B

Updated 4d ago

Evaluation Results

Method	Links
Qwen2.5-7B 2026.01		0.4022
Mistral-7B 2026.01		0.3977
Claude 3.5 Sonnet + FS* 2026.01		0.3948
Qwen2.5-7B + COGLM 2026.01		0.3902
Mistral-7B + COGLM 2026.01		0.3864
Claude 3.5 Sonnet 2026.01		0.3822
LLaMA-3-8B + COGLM 2026.01		0.3665
Gemma-7B 2026.01		0.358
Gemma-7B + COGLM 2026.01		0.3497
DeepSeek V3 2026.01		0.3484
LLaMA-3-8B 2026.01		0.3481
DeepSeek V3 + FS* 2026.01		0.3443
GPT-4o + FS* 2026.01		0.3346
GPT-4o 2026.01		0.3235
DeepSeek-7B 2026.01		0.3065
DeepSeek-7B + COGLM 2026.01		0.3053
Llama 3 (70B) + FS* 2026.01		0.2665
Llama 3 (70B) 2026.01		0.1843