Our new X account is live! Follow @wizwand_team for updates

Question Answering on NQ (Natural Questions) (EM)

78.3EM

InstructRetro 43B

Updated 4d ago

Evaluation Results

Method	Links
InstructRetro 43B 2024.07		78.3
Raven 11B 2024.07		65.7
Llama3-RankRAG 70B 2024.07		54.2
DeepSeek-V2 236B 2024.07		53.4
Llama3-RankRAG 8B 2024.07		50.6
BAR-RAG 2026.02		49.5
BAR-RAG 2026.02		49
BAR-RAG 2026.02		47.5
Llama3-ChatQA-1.5 70B 2024.07		47
BAR-RAG 2026.02		46.9
GPT-3.5-turbo-1106 RAG 2024.07		46.7
BAR-RAG 2026.02		46.1
RAG SFT 2026.02		45.8
BAR-RAG 2026.02		44.7
RAG w/Reranker 2026.02		43.6
Llama3-Instruct 70B 2024.07		42.7
RAG SFT 2026.02		42.7
RAG 2026.02		42.7
Llama3-ChatQA-1.5 8B 2024.07		42.4
BAR-RAG 2026.02		42
GPT-4-turbo-2024-0409 2024.07		41.5
BAR-RAG 2026.02		41.5
RAG w/Reranker 2026.02		40.5
GPT-4-0613 RAG 2024.07		40.4
GPT-4-0613 2024.07		40.3
GPT-4-turbo-2024-0409 RAG 2024.07		40.3
Mixtral-8x22B-Instruct 2024.07		40.1
BAR-RAG 2026.02		40.1
ReFeed 2024.07		39.6
RAG 2026.02		39.3
RAG SFT 2026.02		38.9
GPT-3.5-turbo-1106 2024.07		38.6
GLaM 64B 2024.07		37.5
PaLM2 540B 2024.07		37.1
RECOMP 20B 2024.07		37
RAG w/Reranker 2026.02		35.6
RA-DIT 65B 2024.07		35.2
RAG 2026.02		34.8
GenRead 2024.07		32.5
Retrieve-Read 2024.07		31.7
Llama3-Instruct 8B 2024.07		30.9
InstructGPT 2024.07		29.9
RePlug 65B 2024.07		28.8
CoT 2026.02		27.8
Atlas 11B 2024.07		26.7
IRCoT 2026.02		23.5
IRCoT 2026.02		22.4
PaLM2 540B 2024.07		21.2
FLAN-LaMDA 137B 2024.07		20.7
Direct Inference 2026.02		18.4
Direct Inference 2026.02		13.4
IRCoT 2026.02		11.1
Direct Inference 2026.02		10.6
CoT 2026.02		4.8
CoT 2026.02		2.3