Share your thoughts, 1 month free Claude Pro on usSee more

Multimodal Reasoning on GEO-AT Protein

41.7METEOR

Cuttlefish + Llama-3.1-8B-I

Updated 1mo ago

Evaluation Results

Method	Links
Cuttlefish + Llama-3.1-8B-I 2026.02		41.7	89.6
Cuttlefish + Qwen3-8B 2026.02		37.7	88.8
Cuttlefish + Mistral-3-8B-I 2026.02		33.3	85.8
Cuttlefish + R1-7B 2026.02		32.7	80.1
Cuttlefish + Mistral3-8B-R 2026.02		32	75.6
Cuttlefish + Qwen2.5-7B 2026.02		31.7	81.6
Cuttlefish + GLM-4-9B 2026.02		26.2	83.1
DeepSeek-R1-D-Qwen-7B 2026.02		21.9	61.7
Mistral-3-8B-Reasoning-2512 2026.02		19.2	75.5
Llama-3.1-8B-Instruct 2026.02		17.8	74.2
DeepSeek-R1-D-Qwen-7B 2026.02		14.1	70.7
Mistral-3-8B-Instruct-2512 2026.02		13.4	71.4
GLM-4-9B-0414 2026.02		11	67.2
Mistral-3-8B-Reasoning-2512 2026.02		10.8	81.1
Qwen-2.5-7B-Instruct 2026.02		9.1	65.1
Qwen3-8B 2026.02		4.4	67.9
Qwen3-8B 2026.02		2.7	57.3