Share your thoughts, 1 month free Claude Pro on usSee more

Multimodal Reasoning on GEO-AT DNA

52.9METEOR

Cuttlefish + Llama-3.1-8B-I

Updated 1mo ago

Evaluation Results

Method	Links
Cuttlefish + Llama-3.1-8B-I 2026.02		52.9	81.6
Cuttlefish + GLM-4-9B 2026.02		44.3	88.8
Cuttlefish + Qwen3-8B 2026.02		39.1	86
Cuttlefish + Mistral-3-8B-I 2026.02		35.8	85.2
Cuttlefish + R1-7B 2026.02		33	80.2
Mistral-3-8B-Reasoning-2512 2026.02		26.4	80.6
Cuttlefish + Qwen2.5-7B 2026.02		26.2	80.6
Cuttlefish + Mistral3-8B-R 2026.02		25.6	79.8
DeepSeek-R1-D-Qwen-7B 2026.02		20.6	65.9
GLM-4-9B-0414 2026.02		20.4	69
Qwen3-8B 2026.02		17.7	79.2
Llama-3.1-8B-Instruct 2026.02		17.5	65.8
Qwen-2.5-7B-Instruct 2026.02		17.1	64.4
Mistral-3-8B-Instruct-2512 2026.02		15.6	66.5
Mistral-3-8B-Reasoning-2512 2026.02		14.9	75.6
DeepSeek-R1-D-Qwen-7B 2026.02		14.7	64.4
Qwen3-8B 2026.02		13.1	66.5