Share your thoughts, 1 month free Claude Pro on usSee more

Zero-shot Reasoning on OpenBookQA

44Accuracy

Llama2-7B

Updated 16d ago

Evaluation Results

Method	Links
Llama2-7B 2026.02		44
Baseline 2026.04		34
Dobi-SVD 2026.02		32.8
SVD-LLM(W) 2026.04		31
COMPOT 2026.02		30.4
Dobi-SVD(w) 2026.04		30
Dobi-SVD 2026.02		29.2
ASVD 2026.04		29
Swift-SVD* 2026.04		27
Dobi-SVD 2026.02		26
Swift-SVD 2026.04		26
COMPOT 2026.02		25.2
SVD-LLM(W) 2026.04		25
Swift-SVD* 2026.04		23
Dobi-SVD(w) 2026.04		22
Swift-SVD 2026.04		21
Swift-SVD 2026.04		16
Swift-SVD* 2026.04		16
Dobi-SVD(w) 2026.04		14
COMPOT 2026.02		13.4
SVD-LLM(W) 2026.04		10
FWSVD 2026.04		9
ASVD 2026.04		8
FWSVD 2026.04		6
FWSVD 2026.04		6
ASVD 2026.04		5