Share your thoughts, 1 month free Claude Pro on usSee more

Reasoning on ARC-E

98.1First-Token Accuracy

Zephyr-7B

Updated 1mo ago

Evaluation Results

Method	Links
Zephyr-7B 2025.05		98.1
Gemma-2-9B 2025.05		96.6
Zephyr-7B 2025.05		95.6
Llama-3.1-8B 2025.05		94.7
Qwen-2-7B 2025.05		94.7
Qwen-2-7B 2025.05		94.3
Ministral-8B 2025.05		93.7
Ministral-8B 2025.05		93.6
Mistral-Nemo-12B 2025.05		93.1
Mistral-Nemo-12B 2025.05		92.6
Llama-3.1-8B 2025.05		90.2
Phi-4-14B 2025.05		87.8
Phi-4-14B 2025.05		87.8
Gemma-7B 2025.05		86.7
Gemma-2-9B 2025.05		81.2
Llama-3.1-8B 2025.05		78.7
Mistral-Nemo-12B 2025.05		76.5
Base 2025.10		76.3
Ministral-8B 2025.05		76.1
Qwen-2-7B 2025.05		74.1
Phi-4-14B 2025.05		73.1
PGSVD 2025.10		70.75
Zephyr-7B 2025.05		65.7
LLM-Pruner 2025.10		64.31
Gemma-7B 2025.05		58.7
Gemma-7B 2025.05		55.9
SliceGPT 2025.10		46.09
Gemma-2-9B 2025.05		38.6