Our new X account is live! Follow @wizwand_team for updates

Open-domain question answering on Natural Questions (Macro-averaged EM)

11.4Macro EM

GPT-3 175B

Updated 2d ago

Evaluation Results

Method	Links
GPT-3 175B 2022.12		11.4
BM25 + GPT-3 13B 2022.12		11.2
BM25 + T5 3B 2022.12		10.8
NPM 2022.12		10.8
BM25 + OPT 6.7B 2022.12		10.7
BM25 + OPT 13B 2022.12		10.7
BM25 + GPT-3 6.7B 2022.12		8.8
BM25 + OPT 2.7B 2022.12		8.3
BM25 + GPT-3 175B 2022.12		6.4
BM25 + GPT-3 2.7B 2022.12		6.1
BM25 + T5 2022.12		5.2
GPT-3 13B 2022.12		5.2
OPT 6.7B 2022.12		4.2
OPT 13B 2022.12		4.2
GPT-3 6.7B 2022.12		3.1
OPT 2.7B 2022.12		2.1
T5 3B 2022.12		2
GPT-3 2.7B 2022.12		1.1
T5 2022.12		0.5