SOTA Causal Reasoning on XCOPA and PapersWithCode

94.4Accuracy

PaLM 2

Updated 1mo ago

Evaluation Results

Method	Links
PaLM 2 2023.05		94.4
PaLM + CoT 2023.05		89.9
BYOL-nya 2026.01		71.2
BYOL-nya 2026.01		70
QuaSAR 2025.02		65
BYOL-nya 2026.01		61.2
Gemma-3 2026.01		60.8
Gemma-3 2026.01		57.2
CoT 2025.02		56.9
baseline 2025.02		56.4
DMoE 2025.06		56
DMoE 2025.06		55.7
Branch-Train-Mix 2025.06		55.6
Branch-Train-Mix 2025.06		55.5
BLOOM + Continued Pre-training 2025.06		55.3
BLOOM 2025.06		55.2
BLOOM 2025.06		55.1
BLOOM + Continued Pre-training 2025.06		55
DMoE 2025.06		54.7
DMoE 2025.06		54.4
Branch-Train-Mix 2025.06		54.1
BLOOM 2025.06		53.9
Branch-Train-Mix 2025.06		53.9
BLOOM + Continued Pre-training 2025.06		53.8
BLOOM + Continued Pre-training 2025.06		53.6
BLOOM 2025.06		53.4
Apertus 2026.01		53.2
Qwen-3 2026.01		52.2
Qwen-3 2026.01		52
Gemma-3 2026.01		51.8
Llama-3.1 2026.01		51.2
Qwen-3 2026.01		51
Llama-3.2 2026.01		48.6