Question Answering on ARC Challenge (ARC-c and Avg Metrics)

47.61ARC-c Score

OursQ

Updated 1mo ago

Evaluation Results

Method
OursQ 2026.06	47.61	67.61
Baseline 2026.06	47.53	65.62
Baseline 2026.06	46.93	68.6
Wanda 2026.06	46.84	66.62
MoNE 2026.06	46.67	65.65
Wanda 2026.06	46.59	69.2
EAC-MoE 2026.06	46.16	65.3
EAC-MoE 2026.06	45.05	62.7
MoNE 2026.06	44.86	63.97
He et al. 2026.06	44.86	63.97
Wanda 2026.06	44.54	61.56
Wanda 2026.06	44.37	60.82
He et al. 2026.06	44	59.7
PuzzleMoE 2026.06	44	62.36
OursQ 2026.06	43.77	63.78
PuzzleMoE 2026.06	43	62.08
Attribution-guided and Coverage-Maximized Expert-wise Pruning 2026.06	42.58	62.34
MoE-I2 2026.06	42.58	59.62
Attribution-guided and Coverage-Maximized Expert-wise Pruning 2026.06	42.49	64.92
C-Prune 2026.06	41.72	61.81
MoNE 2026.06	37.2	59.8
He et al. 2026.06	33.15	53.88
Wanda 2026.06	31.4	49.29
He et al. 2026.06	28.67	44.17
C-Prune 2026.06	24.4	42.39
MoNE 2026.06	22.7	33.94
MoNE 2026.06	22.53	33.24