Share your thoughts, 1 month free Claude Pro on usSee more

Open-set knowledge retrieval on T-REx (All)

34.5Macro-averaged EM

NPM

Updated 1mo ago

Evaluation Results

Method	Links
NPM 2022.12		34.5
BM25 + GPT-3 175B 2022.12		32
GPT-3 175B 2022.12		25.7
BM25 + T5 2022.12		22.2
BM25 + GPT-3 13B 2022.12		22.2
BM25 + T5 3B 2022.12		21.6
BM25 + OPT 13B 2022.12		18.9
GPT-3 13B 2022.12		16.4
OPT 13B 2022.12		15
BM25 + GPT-3 6.7B 2022.12		14.9
BM25 + OPT 2.7B 2022.12		14.8
BM25 + OPT 6.7B 2022.12		14.8
T5 2022.12		13.3
T5 3B 2022.12		12.1
OPT 6.7B 2022.12		11.6
OPT 2.7B 2022.12		9.8
GPT-3 6.7B 2022.12		8.1
GPT-3 2.7B 2022.12		4.4
BM25 + GPT-3 2.7B 2022.12		3.5