Our new X account is live! Follow @wizwand_team for updates

Question Answering on Hotpot QA (val)

24.6EM

Llama2-7b CBQA w. Mixed Training

Updated 4d ago

Evaluation Results

Method	Links
Llama2-7b CBQA w. Mixed Training 2024.03		24.6	34.6	-
Llama2-7b Closed-book QA 2024.03		24.1	33.8	-
Llama2-7b + Recitation 2024.03		22.7	31.4	22.2
Llama2-7b CBQA w. Mixed Training + Recitation 2024.03		22.4	30.7	23.8
Qwen1.5-4b CBQA w. Mixed Training 2024.03		19.3	28.3	-
Qwen1.5-4b Closed-book QA 2024.03		18.6	27	-
Qwen1.5-4b CBQA w. Mixed Training + Recitation 2024.03		18.4	25.1	32.7
Qwen1.5-4b + Recitation 2024.03		16.7	24.5	17.4