Share your thoughts, 1 month free Claude Pro on usSee more

Reading Comprehension on RACE-h

62.3Accuracy

PaLM 2-L

Updated 20d ago

Evaluation Results

Method	Links
PaLM 2-L 2023.05		62.3
PaLM 2-M 2023.05		57.2
PaLM 2-S 2023.05		53.3
PaLM 2023.05		52.1
GPT-3 (Original) 2021.08		41.4
EMO (Stage 5) 2026.05		40.39
FIXED_E=128 2026.05		40.31
FIXED_E=16 2026.05		40.05
EMO (Stage 4) 2026.05		39.71
FIXED_E=32 2026.05		39.59
EMO (Stage 3) 2026.05		38.51
EMO (Stage 2) 2026.05		37.91
GPT-3 (SLW 8x Bsz) 2021.08		37.6
EMO (Stage 1) 2026.05		37.36
GPT-3 (Baseline repro) 2021.08		35
INTRADOC 2024.02		34.49
UNIChunk 2024.02		34.01
BM25Chunk 2024.02		33.17
INTRADOC 2024.02		33.17
BM25Chunk 2024.02		32.63
MIXChunk 2024.02		32.34
UNIChunk 2024.02		31.68
MIXChunk 2024.02		31.66
+49-class Div. 2026.02		28.73
+3-class Div. 2026.02		28.69
Baseline MoE 2026.02		28.34