Share your thoughts, 1 month free Claude Pro on usSee more

Error prediction on NCQA (test)

99.2AUROC

Llama-3.1-8B

Updated 1d ago

Evaluation Results

Method
Llama-3.1-8B 2026.06	99.2	-
Llama-3.1-8B 2026.06	99.2	-
Llama-3.1-8B 2026.06	99.1	-
Llama-3.1-8B 2026.06	99.1	-
Llama-3.1-8B 2026.06	98.9	-
Llama-3.1-8B 2026.06	98.8	-
Llama-3.1-8B 2026.06	98.5	-
Qwen3-14B 2026.06	98.4	-
Spectrum-Llama-3.1-8B 2026.06	98.3	-
Spectrum-Qwen3-14B 2026.06	98.2	-
Qwen3-14B 2026.06	97	-
A2Search-7B 2026.06	93.8	-
A2Search-7B 2026.06	93.1	-
Qwen3-14B (all UQ - latent gated) 2026.06	92.7	-
A2Search-7B 2026.06	91.8	-
Llama-3.1-8B (all UQ - latent gated) 2026.06	84.6	-
Spectrum-Llama-3.1-8B (SAR - baseline) 2026.06	83.7	-
Qwen3-14B 2026.06	79.4	-
Qwen3-14B 2026.06	77.6	-
Qwen3-14B 2026.06	76.8	-
A2Search-7B 2026.06	76.8	-
A2Search-7B 2026.06	76.6	-
A2Search-7B 2026.06	76.5	-
Spectrum-Qwen3-14B 2026.06	75.2	-
A2Search-7B 2026.06	74.8	-
Spectrum-Llama-3.1-8B (all UQ - latent selective) 2026.06	73.9	-
A2Search-7B (all UQ - latent gated) 2026.06	73.7	-
Qwen3-14B 2026.06	73	-
Qwen3-14B 2026.06	72.3	-
A2Search-7B 2026.06	72.2	-
Llama-3.1-8B (all UQ) 2026.06	71.8	-
Qwen3-14B (Semantic energy - latent selective) 2026.06	70.8	-
Qwen3-14B 2026.06	70.4	-
A2Search-7B 2026.06	69.9	-
A2Search-7B 2026.06	69	-
A2Search-7B (MSP - oracle selective) 2026.06	68.7	-
Spectrum-Qwen3-14B (SAR - latent gated) 2026.06	68.6	-
A2Search-7B 2026.06	68.3	-
Spectrum-Qwen3-14B 2026.06	68	-
Llama-3.1-8B (CoCoA - baseline) 2026.06	67.6	-
Spectrum-Llama-3.1-8B 2026.06	67.2	-
Qwen3-14B 2026.06	66.7	-
A2Search-7B 2026.06	66.7	-
Llama-3.1-8B 2026.06	66.5	-
A2Search-7B 2026.06	66.2	-
Qwen3-14B 2026.06	65.5	-
Llama-3.1-8B 2026.06	65.2	-
Llama-3.1-8B 2026.06	64.9	-
A2Search-7B 2026.06	64.9	-
Llama-3.1-8B 2026.06	64.6	-
Llama-3.1-8B 2026.06	63.9	-
Llama-3.1-8B 2026.06	63.7	-
Llama-3.1-8B 2026.06	63.6	-
Llama-3.1-8B 2026.06	63.2	-
Llama-3.1-8B 2026.06	62	-
Llama-3.1-8B 2026.06	61.8	-
Llama-3.1-8B 2026.06	61.5	-
Llama-3.1-8B 2026.06	61	-
Llama-3.1-8B 2026.06	60.9	-
Llama-3.1-8B 2026.06	60.5	-
A2Search-7B 2026.06	60.4	-
Llama-3.1-8B 2026.06	59.9	-
Llama-3.1-8B 2026.06	59.8	-
Llama-3.1-8B 2026.06	59.1	-
Llama-3.1-8B 2026.06	59	-
Llama-3.1-8B 2026.06	58.4	-
Llama-3.1-8B 2026.06	58.1	-
Llama-3.1-8B 2026.06	57.8	-
Spectrum-Llama-3.1-8B 2026.06	57.8	-
Llama-3.1-8B 2026.06	56.9	-
Llama-3.1-8B 2026.06	56.9	-
Llama-3.1-8B 2026.06	54.7	-
Llama-3.1-8B 2026.06	54.2	-
Llama-3.1-8B 2026.06	52.9	-
Llama-3.1-8B 2026.06	50.8	-
Llama-3.1-8B 2026.06	49	-
baseline 2026.06	-	0.499
latent gated 2026.06	-	0.577
oracle gated 2026.06	-	0.967
latent selective 2026.06	-	0.534
oracle selective 2026.06	-	0.973
baseline 2026.06	-	0.476
latent gated 2026.06	-	0.606
oracle gated 2026.06	-	0.963
latent selective 2026.06	-	0.52
oracle selective 2026.06	-	0.964
baseline 2026.06	-	0.468
latent gated 2026.06	-	0.489
oracle gated 2026.06	-	0.971
latent selective 2026.06	-	0.436
oracle selective 2026.06	-	0.972
baseline 2026.06	-	0.086
latent gated 2026.06	-	0.533
oracle gated 2026.06	-	0.968
latent selective 2026.06	-	-0.545
oracle selective 2026.06	-	0.956
baseline 2026.06	-	0.684
latent gated 2026.06	-	0.644
oracle gated 2026.06	-	0.984
latent selective 2026.06	-	-0.319

Showing 100 of 111 rows