Share your thoughts, 1 month free Claude Pro on usSee more

Multiple-choice Question Answering on BoolQ

0.887MC Accuracy

Original

Updated 5d ago

Evaluation Results

Method	Links
Original 2026.05		0.887
Frequency 2026.05		0.885
ConMoE 2026.05		0.885
M-SMoE 2026.05		0.884
REAP 2026.05		0.881
Frequency 2026.05		0.874
REAP 2026.05		0.861
HC-SMoE 2026.05		0.859
ConMoE 2026.05		0.851
Spherical Steering 2026.02		0.8294
CAA 2026.02		0.8242
M-SMoE 2026.05		0.818
ITI 2026.02		0.8153
SADI-HEAD 2026.02		0.802
Baseline 2026.02		0.8012
HC-SMoE 2026.05		0.755
ConMoE 2026.05		0.745
Original 2026.05		0.74
M-SMoE 2026.05		0.738
HC-SMoE 2026.05		0.734
AR (autoregressive) 2026.05		0.719
Original 2026.05		0.704
Frequency 2026.05		0.699
ConMoE 2026.05		0.697
REAP 2026.05		0.692
HC-SMoE 2026.05		0.678
HC-SMoE 2026.05		0.659
Frequency 2026.05		0.643
AR (autoregressive, ours) 2026.05		0.636
Frequency 2026.05		0.635
REAP 2026.05		0.631
M-SMoE 2026.05		0.631
MDLM (masked diffusion) 2026.05		0.628
M-SMoE 2026.05		0.619
ConMoE 2026.05		0.618
SMDM-1B 2026.05		0.615
Duo (uniform diffusion) 2026.05		0.596
REAP 2026.05		0.589
ConMoE 2026.05		0.579
HC-SMoE 2026.05		0.578
Frequency 2026.05		0.573
Eso-LM (interpolating) 2026.05		0.534
Chance 2026.05		0.504
REAP 2026.05		0.499
M-SMoE 2026.05		0.429
CFM (ours) 2026.05		0.425