Our new X account is live! Follow @wizwand_team for updates

Contextual Robustness Question Answering on ConflictQA Unknown queries

99.28Accuracy (Short Context)

COT

Updated 4d ago

Evaluation Results

Method	Links
COT 2025.02		99.28	96.28
COT 2025.02		98.32	95.23
Grft 2025.02		98.23	97.03
Grft-requery 2025.02		97.3	96.99
LLM 2025.02		97.27	97.09
LLM 2025.02		96.89	97.52
System Prompt 2025.02		96.85	95.72
FT-Llama-Full 2025.02		96.29	93.08
ICL 2025.02		96.1	97.69
ReFT-Gate 2025.02		95.99	97.49
FT-Llama-Lora 2025.02		95.52	89.79
ReFT-Gate-re-query 2025.02		95.38	97.51
FT-Llama-Full 2025.02		95.26	94.39
FT-Llama-Lora 2025.02		94.32	96.03
Grft-W/O Loss 2025.02		92.36	90.17
ReFT-Gate-W/O loss 2025.02		92.09	91.05
ReFT(Training) 2025.02		91.18	89.07
System Prompt 2025.02		89.33	98.08
Grft-W/O Gate 2025.02		89.03	88.36
Astute-RAG 2025.02		81.66	81.46
ICL 2025.02		80.81	92
Astute-RAG 2025.02		72.88	86.73