Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Reading Comprehension on SQuAD (Accuracy)
Loading...
84.1
Accuracy
Mixtral
30.7376
44.5913
58.445
72.2987
Feb 21, 2024
Mar 18, 2024
Apr 14, 2024
May 11, 2024
Jun 7, 2024
Jul 4, 2024
Jul 31, 2024
Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy
Mixtral
Parameters=8x22B
2024.07
84.1
Gemma
Parameters=7B
2024.07
81.8
Llama 3
Parameters=70B
2024.07
81.8
Llama 3
Parameters=405B
2024.07
81.8
Llama 3
Parameters=8B
2024.07
77
Mistral
Parameters=7B
2024.07
73.2
INTRADOC
Chunk Length (L)=8K
2024.02
41.32
INTRADOC
Chunk Length (L)=2K
2024.02
39.91
BM25Chunk
Chunk Length (L)=8K
2024.02
39.45
BM25Chunk
Chunk Length (L)=2K
2024.02
37.91
UNIChunk
Chunk Length (L)=2K
2024.02
37.33
MIXChunk
Chunk Length (L)=2K
2024.02
36.7
UNIChunk
Chunk Length (L)=8K
2024.02
34.94
MIXChunk
Chunk Length (L)=8K
2024.02
32.79
Feedback
Search any
task
Search any
task
