Our new X account is live! Follow @wizwand_team for updates

Open-set knowledge retrieval on T-REx (Hard)

32.1Macro EM

NPM

Updated 2d ago

Evaluation Results

Method	Links
NPM 2022.12		32.1
BM25 + GPT-3 175B 2022.12		31.3
GPT-3 175B 2022.12		24.7
BM25 + T5 2022.12		22.4
BM25 + GPT-3 13B 2022.12		22.4
BM25 + T5 3B 2022.12		21.8
BM25 + OPT 13B 2022.12		19.3
GPT-3 13B 2022.12		15.5
BM25 + GPT-3 6.7B 2022.12		15.1
BM25 + OPT 6.7B 2022.12		14.9
BM25 + OPT 2.7B 2022.12		13.8
OPT 13B 2022.12		12.7
T5 3B 2022.12		11.5
T5 2022.12		10.7
OPT 6.7B 2022.12		10.7
OPT 2.7B 2022.12		8.3
GPT-3 6.7B 2022.12		6.7
GPT-3 2.7B 2022.12		3.8
BM25 + GPT-3 2.7B 2022.12		3.6