Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Reading Comprehension on RACE-h
Loading...
62.3
Accuracy
PaLM 2-L
30.4344
38.7072
46.98
55.2528
Aug 13, 2021
Jan 13, 2022
Jun 16, 2022
Nov 17, 2022
Apr 19, 2023
Sep 20, 2023
Feb 21, 2024
Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy
PaLM 2-L
prompting=1-shot
2023.05
62.3
PaLM 2-M
prompting=1-shot
2023.05
57.2
PaLM 2-S
prompting=1-shot
2023.05
53.3
PaLM
prompting=1-shot
2023.05
52.1
GPT-3 (Original)
few-shot (k)=10
2021.08
41.4
GPT-3 (SLW 8x Bsz)
few-shot (k)=10
2021.08
37.6
GPT-3 (Baseline repro)
few-shot (k)=10
2021.08
35
INTRADOC
Chunk Length (L)=2K
2024.02
34.49
UNIChunk
Chunk Length (L)=2K
2024.02
34.01
BM25Chunk
Chunk Length (L)=2K
2024.02
33.17
INTRADOC
Chunk Length (L)=8K
2024.02
33.17
BM25Chunk
Chunk Length (L)=8K
2024.02
32.63
MIXChunk
Chunk Length (L)=2K
2024.02
32.34
UNIChunk
Chunk Length (L)=8K
2024.02
31.68
MIXChunk
Chunk Length (L)=8K
2024.02
31.66
Feedback
Search any
task
Search any
task