Share your thoughts, 1 month free Claude Pro on usSee more

General Knowledge on MMLU (test)

87.6Accuracy

SC-MAS

Updated 22d ago

Evaluation Results

Method	Links
SC-MAS 2026.01		87.6
MasRouter 2026.01		84.25
GPTSwarm 2026.01		83.22
AgentPrune 2026.01		83.1
AFlow 2026.01		83.1
AgentPrune 2026.01		83.02
GPTSwarm 2026.01		82.8
AFlow 2026.01		82.35
RouterDC 2026.01		82.01
RouteLLM 2026.01		81.04
Vanilla 2026.01		80.04
Vanilla 2026.01		79.08
PromptLLM 2026.01		78.43
Vanilla 2026.01		77.81
TiDAR-8B 2026.06		76.57
FrugalGPT 2026.01		76.24
VDLM 2026.01		73.9
Qwen3-4B-Base 2026.06		71.76
Dream-7B-Base 2026.06		69.5
FReDA-4B 2026.06		69.11
FReDA-4B 2026.06		69.11
LLaMA3 8B 2026.01		68.4
Vanilla 2026.01		67.97
LLaDA-8B-Base 2026.06		65.9
Qwen2.5-3B-Base 2026.06		65.6
LLaDA 8B 2026.01		65.5
LLaDA-MoE-7B-A1B-Base 2026.06		64.59
BlockDiff-4B 2026.06		64.56
PARTREP 2026.07		63.2
No Repetition 2026.07		62.5
LLMLingua 2026.07		61
Naïve Summary 2026.07		60.8
H2O Eviction 2026.07		60.5
Full Repetition 2026.07		60.3
Echo Eviction 2026.07		60.3
Llama-3.3-70B-Base 2026.02		54.9
Gemma-3-27B-Base 2026.02		54.7
Qwen-3-14B-Base 2026.02		54.2
Mistral-3.2-24B-Base 2026.02		53.9
Qwen-3-30B-A3B-Base 2026.02		53
SASFT 2025.07		52.11
OLMo-3-32B-Base 2026.02		52
Gemma-3-12B-Base 2026.02		51.9
SFT+Penalty 2025.07		51.56
SFT 2025.07		50.73
Apertus-70B-Base 2026.02		49.4
Deepseek 7B 2026.01		49.4
SFT+GRPO 2025.07		48.63
Apertus-8B-Base 2026.02		47.1
EuroLLM-22B-Base 2026.02		46.4
Llama-3.1-8B-Base 2026.02		46.3
OLMo-3-7B-Base 2026.02		46
SFT 2025.07		45.55
SFT+GRPO 2025.07		44.99
SFT+Penalty 2025.07		44.51
EuroLLM-9B-Base 2026.02		43.9
SASFT 2025.07		43.55
SFT+Penalty 2025.07		38.38
SASFT 2025.07		38.23
SFT 2025.07		38.06
SFT+GRPO 2025.07		37.88
SASFT 2025.07		34.53
SFT 2025.07		33.97
SFT+GRPO 2025.07		33.71
SFT+Penalty 2025.07		33.29
SFT 2025.07		28.36
SFT+Penalty 2025.07		28.32
SASFT 2025.07		28.09
SFT+GRPO 2025.07		28.04
DiffuLLaMA-7B 2026.06		27.42
LLMLingua Comp. 2026.07		14.8