Share your thoughts, 1 month free Claude Pro on usSee more

Multiple Choice Question Answering on IndoCulture native prompts (test)

67.5Accuracy

Gemma2-9B

Updated 1mo ago

Evaluation Results

Method	Links
Gemma2-9B 2026.01		67.5
Qwen2.5-7B-IT 2026.01		67.5
Qwen2.5-7B-IT 2026.01		67.2
Qwen2.5-7B-IT 2026.01		66.9
Qwen2.5-7B-IT 2026.01		66.3
Qwen2.5-7B-IT 2026.01		66.2
Qwen2.5-7B-IT 2026.01		66.1
Gemma2-9B 2026.01		65.9
Gemma2-9B 2026.01		65.7
Qwen2.5-7B-IT 2026.01		65.3
Gemma2-9B 2026.01		65.2
Gemma2-9B 2026.01		65
Gemma2-9B 2026.01		64.8
Gemma2-9B 2026.01		64.6
Qwen2.5-7B-IT 2026.01		63.5
Gemma2-9B-IT 2026.01		61
Qwen2.5-7B 2026.01		60.8
Qwen2.5-7B 2026.01		60.1
Qwen2.5-7B 2026.01		59.8
Qwen2.5-7B 2026.01		59.7
Gemma2-9B-IT 2026.01		59.4
Qwen2.5-7B 2026.01		59.1
Gemma2-9B-IT 2026.01		59.1
Llama3.1-8B-IT 2026.01		59
Qwen2.5-7B 2026.01		58.6
Gemma2-9B-IT 2026.01		58.5
Qwen2.5-7B 2026.01		58.5
Gemma2-9B-IT 2026.01		57.9
Gemma2-9B-IT 2026.01		57.9
Gemma2-9B-IT 2026.01		57.3
Llama3.2-1B 2026.01		57.1
Llama3.1-8B-IT 2026.01		56.4
Llama3.1-8B-IT 2026.01		55.9
Llama3.1-8B-IT 2026.01		55.5
Llama3.1-8B-IT 2026.01		54.4
Llama3.1-8B-IT 2026.01		54.4
Qwen2.5-3B 2026.01		54.3
Llama3.1-8B-IT 2026.01		54.2
Qwen2.5-3B 2026.01		53.6
Qwen2.5-7B 2026.01		53.4
Llama3.2-1B 2026.01		53.4
Llama3.1-8B-IT 2026.01		53.4
Qwen2.5-3B 2026.01		53.2
Gemma2-9B 2026.01		53.2
Qwen2.5-3B 2026.01		53.1
Llama3.2-1B 2026.01		53.1
Qwen2.5-3B 2026.01		53
Qwen2.5-3B 2026.01		51.8
Qwen2.5-3B 2026.01		51.7
Llama3.2-1B 2026.01		51
Llama3.2-1B 2026.01		50.9
Llama3.2-3B 2026.01		50.5
Llama3.2-3B 2026.01		50
Llama3.2-3B 2026.01		49.6
Llama3.2-3B 2026.01		49.4
Llama3.2-3B 2026.01		49.4
Llama3.2-3B 2026.01		49.2
Llama3.2-1B 2026.01		48.9
Llama3.2-3B 2026.01		48.3
Llama3.2-1B 2026.01		46.9
Qwen2.5-1.5B 2026.01		45.5
Qwen2.5-1.5B 2026.01		45.2
Qwen2.5-1.5B 2026.01		45
Qwen2.5-1.5B 2026.01		44.8
Qwen2.5-1.5B 2026.01		44.5
Llama3.2-1B 2026.01		44.5
Qwen2.5-1.5B 2026.01		43.8
Qwen2.5-0.5B 2026.01		43.5
Qwen2.5-0.5B 2026.01		43.4
Qwen2.5-0.5B 2026.01		43.1
Qwen2.5-0.5B 2026.01		42.2
Qwen2.5-0.5B 2026.01		41.9
Qwen2.5-1.5B 2026.01		41.8
Qwen2.5-0.5B 2026.01		41.6
Qwen2.5-0.5B 2026.01		41.6
Llama3.2-3B 2026.01		41.3
Qwen2.5-0.5B 2026.01		40.9
Qwen2.5-0.5B 2026.01		40.8
Qwen2.5-0.5B 2026.01		40.6
Gemma2-2B 2026.01		39.4
Gemma2-9B-IT 2026.01		39.1
Qwen2.5-0.5B 2026.01		39
Qwen2.5-0.5B 2026.01		38.5
Gemma2-2B 2026.01		38.3
Gemma2-2B 2026.01		38.2
Gemma2-2B 2026.01		37.5
Qwen2.5-0.5B 2026.01		37.3
Qwen2.5-0.5B 2026.01		35.8
Gemma2-2B 2026.01		35.7
Llama3.1-8B 2026.01		35.6
Llama3.1-8B 2026.01		35.6
Gemma2-2B 2026.01		35.5
Gemma2-2B 2026.01		33.4
Llama3.1-8B 2026.01		32.7
Llama3.1-8B 2026.01		32.7
Llama3.1-8B 2026.01		32.7
Llama3.1-8B 2026.01		32.7
Llama3.1-8B 2026.01		32.7
Llama3.1-8B 2026.01		32.7