Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Closed-book Question Answering on Natural Questions (dev)
Loading...
54.4
Accuracy
FiD + Distillation
8.328
20.289
32.25
44.211
Mar 29, 2022
Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy
FiD + Distillation
evaluation_protocol=op...
2022.03
54.4
Chinchilla
shots=64-shot
2022.03
35.5
Chinchilla
shots=5-shot
2022.03
31.5
GPT-3
shots=64-shot
2022.03
29.9
Gopher
shots=64-shot
2022.03
28.2
Gopher
shots=5-shot
2022.03
24.5
Chinchilla
shots=0-shot
2022.03
16.6
GPT-3
shots=0-shot
2022.03
14.6
Gopher
shots=0-shot
2022.03
10.1
Feedback
Search any
task
Search any
task