Share your thoughts, 1 month free Claude Pro on usSee more

Question Answering on PopQA (Accuracy)

87.12Accuracy

NWCAD

Updated 17d ago

Evaluation Results

Method	Links
NWCAD 2026.04		87.12
NWCAD 2026.04		85.69
AdaCAD 2026.04		85.62
With-context 2026.04		85.12
AdaCAD 2026.04		84.94
NWCAD 2026.04		84.12
CoCoA 2026.04		84.12
With-context 2026.04		83.81
AdaCAD 2026.04		82.69
With-context 2026.04		82.38
CoCoA 2026.04		80.94
KARLA 2026.06		80.91
KARLA 2026.06		80.63
CAD 2026.04		80.31
KARLA 2026.06		78.98
KARLA 2026.06		78.56
CAD 2026.04		78.44
NWCAD 2026.04		77.88
NWCAD 2026.04		75.29
AdaCAD 2026.04		74.62
Neuro-RIT 2026.04		74.29
CoCoA 2026.04		74
AdaCAD 2026.04		73.4
NWCAD 2026.04		72.8
CoCoA 2026.04		72.8
CAD 2026.04		72.5
CoCoA 2026.04		72.38
AdaCAD 2026.04		71.8
PA-RAG 2026.04		71.08
Neuro-RIT + Reranker 2026.04		70.65
No compression 2025.03		70
No compression 2025.03		70
OSCAR-llama 2025.03		70
RALM + Reranker 2026.04		69.05
Provence 2025.03		69
With-context 2026.04		68.88
CoCoA 2026.04		68.8
OSCAR-llama 2025.03		68
OSCAR-8-Layers 2025.03		68
OSCAR-llama 2025.03		68
Neuro-RIT 2026.04		67.37
RECOMP 2025.03		67
OSCAR-8-Layers 2025.03		67
KARLA-no-desc 2026.06		66.98
KARLA-no-desc 2026.06		66.38
OSCAR-5-Layers 2025.03		66
KARLA-no-desc 2026.06		65.76
PA-RAG 2026.04		65.68
CAD 2026.04		65.6
With-context 2026.04		65.2
InstructRAG 2026.04		64.6
PA-RAG 2026.04		64.37
Neuro-RIT 2026.04		64.15
PISCO 2025.03		64
No compression 2025.03		64
CAD 2026.04		63.6
Neuro-RIT 2026.04		63.28
Neuro-RIT + RankCoT 2026.04		63.19
RALM 2026.04		62.78
With-context 2026.04		62.4
InstructRAG 2026.04		62.24
RALM 2026.04		60.85
RALM + RankCoT 2026.04		60.83
RALM 2026.04		60.37
InstructRAG 2026.04		60.25
RALM 2026.04		59.8
No compression 2025.03		59
OSCAR-5-Layers 2025.03		59
CAD 2026.04		59
1-hop graph RAG 2026.06		58.68
1-hop graph RAG 2026.06		56.17
KARLA-no-desc 2026.06		55.97
1-hop graph RAG 2026.06		55.02
RetRobust 2026.04		54.92
1-hop graph RAG 2026.06		54.45
RetRobust 2026.04		53.24
RetRobust 2026.04		53.18
LMLM 2026.06		52
LMLM 2026.06		50.8
State-SFT & RL‡ 2026.06		42.8
FE-SFT & FC-RL 2026.06		42.6
Tool-schema prompt 2026.06		41.74
RAG 2026.02		41.3
State-SFT & RL† 2026.06		40.8
FE-SFT & RL 2026.06		40.8
RAG 2026.02		39.57
IWM & RL 2026.06		38.8
FE-SFT & RL* 2026.06		38.2
Tool-schema prompt 2026.06		35.67
SFT & RL 2026.06		35.6
CDKC 2026.02		35.2
SFT & RL* 2026.06		35.2
GRPO 2026.02		34.23
FE-SFT 2026.06		33.8
SFT 2026.06		32.6
IWM 2026.06		31.8
RL 2026.05		31.44
SFT* 2026.06		31
FE-SFT* 2026.06		30.6
SFT 2026.05		29.52

Showing 100 of 158 rows