Our new X account is live! Follow @wizwand_team for updates

Multiple-Choice on TruthfulQA

58.5MC1 Accuracy

F-DPO

Updated 3d ago

Evaluation Results

Method
F-DPO 2026.01	58.5	53.1	58.5	-
Factual SFT + F-DPO 2026.01	56.1	51.5	56.1	-
TruthX 2024.02	54.22	73.9	44.37	-
CoCoASIG 2026.02	52.39	60.69	39.89	-
CoCoASIG 2026.02	52.26	63.62	39.94	-
CoCoASIG 2026.02	52.14	65.8	39.87	-
CoCoASIG 2026.02	52.02	57.37	39.72	-
CoCoASIG 2026.02	52.02	58.3	39.7	-
DeCoRe 2026.02	51.77	65.51	38.98	-
CoCoASIG 2026.02	51.53	60.06	39.55	-
ITI 2025.03	51.23	65.78	39.32	-
Mistral-Instruct-v0.2 + TACS-T 2024.03	51	72	44.4	55.8
Base Model 2026.01	50	35.7	50	-
Spherical Steering 2026.02	49.95	68.51	41.05	53.17
HICD 2025.03	49.75	65.63	37.92	-
Mistral-7b-v0.3 2025.03	49.71	63.23	37.15	-
Spherical Steering 2026.02	48.71	66.9	39.16	51.59
DeCoRe 2025.03	48.23	59.14	35.21	-
Standard DPO 2026.01	47.2	36.2	47.2	-
CoCoASIG 2026.02	46.39	58.44	33.62	-
CoCoASIG 2026.02	46.39	61.21	33.64	-
ICD 2024.02	46.32	69.08	41.25	-
CoCoASIG 2026.02	46.14	55.22	33.56	-
CoCoASIG 2026.02	46.14	51.76	33.69	-
CoCoASIG 2026.02	46.14	52.05	33.65	-
CoCoASIG 2026.02	45.9	51.64	33.55	-
DoLa 2026.02	45.78	65.63	37.15	-
Baseline 2026.02	45.65	65.61	37.09	-
Factual SFT + Standard DPO 2026.01	45.2	34	45.2	-
CoCoASIG 2026.02	45.17	54.89	33.4	-
CoCoASIG 2026.02	45.04	52.83	33.45	-
CoCoASIG 2026.02	45.04	53.53	33.33	-
CoCoASIG 2026.02	44.8	55.61	33.25	-
CoCoASIG 2026.02	44.68	57.93	33.13	-
CoCoASIG 2026.02	44.68	59.78	33.13	-
CoCoASIG 2026.02	43.82	50.78	32.22	-
CoCoASIG 2026.02	43.7	50.64	32.08	-
CoCoASIG 2026.02	43.57	51.12	32.14	-
CoCoASIG 2026.02	43.33	53.88	31.95	-
CoCoASIG 2026.02	43.33	56.9	31.89	-
CoCoASIG 2026.02	43.33	59.59	32.01	-
5-shot ICL 2026.02	43.33	63.36	32.15	46.28
Baseline 2026.02	42.72	61.76	33.58	-
DeCoRe 2026.02	42.35	62.72	34.44	-
ITI 2025.03	41.37	59.78	34.81	-
Mistral-Instruct-v0.2 + TACS-S 2024.03	40.8	69.6	36.3	48.9
HICD 2025.03	40.21	59.79	34.45	-
CAA 2026.02	40.16	59.08	30.41	43.22
ITI 2026.02	40.15	58.93	30.26	43.11
Baseline 2026.02	39.78	60.03	32.32	-
Baseline 2026.02	39.41	58.84	32.45	-
Llama3-8B-Instruct 2025.03	39.31	56.91	30.43	-
Factual SFT 2026.01	39.3	29.6	39.3	-
SADI-HEAD 2026.02	39.28	56.61	29.32	41.74
SADI-HEAD 2026.02	38.53	56.03	30.57	41.71
DeCoRe 2025.03	38.43	55.86	30.31	-
5-shot ICL 2026.02	38.31	57.85	30.09	42.08
DoLa 2026.02	38.19	58.62	31.95	-
ITI 2026.02	37.7	58.09	30.12	41.97
DeCoRe 2026.02	37.58	54.19	29.98	-
Llama 2-Chat + TACS-T 2024.03	37.2	64.8	34.8	45.6
Mistral-Instruct-v0.2 2024.03	37.2	69.1	33.1	46.5
SFT 2026.01	37.1	28.6	37.1	-
TrFr 2024.02	36.7	-	-	-
Llama 2-Chat + TACS-S 2024.03	36.5	64	33.4	44.6
CAA 2026.02	35.99	56.26	29.36	40.54
Baseline 2026.02	35.87	54.95	26.62	39.15
Llama-2-7B-Chat 2024.02	34.64	51.31	25.1	-
ITI 2024.02	34.64	51.55	25.32	-
Baseline 2026.02	34.15	53.32	27.02	38.16
SH2 2024.02	33.9	57.07	29.79	-
DoLa 2024.02	32.2	63.8	32.1	-
DoLa 2026.02	29.87	53.61	27.79	-
Llama 2-Chat 2024.03	29.7	61.7	27.1	39.5
Llama 2-Chat + ITI 2024.03	28.5	59.7	25.9	38.1
Diver 2026.02	28.27	54.03	28.75	-
CSS 2024.02	26.2	-	-	-
CD 2024.02	24.4	41	19	-
Supervised Finetuning 2024.02	24.2	-	-	-
DoLa 2026.02	23.38	48	24.44	-
Diver 2026.02	21.05	50.03	24.94	-
Diver 2026.02	20.2	42.05	20.13	-
Diver 2026.02	20.2	52.04	26.34	-