Share your thoughts, 1 month free Claude Pro on usSee more

Error Prediction on TriviaQA (val)

81.3PRR

latent selective

Updated 1d ago

Evaluation Results

Method	Links
latent selective 2026.06		81.3
latent gated 2026.06		79.5
latent selective 2026.06		79.3
oracle gated 2026.06		78.8
baseline 2026.06		78.7
latent selective 2026.06		78.6
latent selective 2026.06		78.4
oracle selective 2026.06		77.8
latent gated 2026.06		77.8
latent gated 2026.06		77.3
latent gated 2026.06		77.3
latent selective 2026.06		77.1
latent selective 2026.06		76.1
latent gated 2026.06		75.9
latent gated 2026.06		75.8
oracle gated 2026.06		75.7
baseline 2026.06		75.4
baseline 2026.06		75.3
oracle gated 2026.06		75.2
oracle selective 2026.06		74.8
oracle selective 2026.06		74.2
oracle gated 2026.06		73.9
baseline 2026.06		73.8
oracle gated 2026.06		73.8
baseline 2026.06		73.5
oracle selective 2026.06		72.9
oracle selective 2026.06		72.5
oracle gated 2026.06		67.3
oracle selective 2026.06		67.1
baseline 2026.06		64.1
latent selective 2026.06		56.9
latent gated 2026.06		56.8
baseline 2026.06		20.4
oracle selective 2026.06		19.7
oracle gated 2026.06		19.6
Selective Prediction framework (Spectrum-Qwen3-14B, all UQ) 2026.06		0.858
Baseline (Spectrum-Qwen3-14B, all UQ) 2026.06		0.854
Selective Prediction framework (Llama-3.1-8B, all UQ) 2026.06		0.85
Gated Experts model (Llama-3.1-8B, all UQ) 2026.06		0.849
Baseline (Llama-3.1-8B, all UQ) 2026.06		0.848
Selective Prediction framework (Spectrum-Llama-3.1-8B, all UQ) 2026.06		0.836
Baseline (Spectrum-Llama-3.1-8B, all UQ) 2026.06		0.831
Selective Prediction framework (Qwen3-14B, all UQ) 2026.06		0.813
Baseline (Qwen3-14B, all UQ) 2026.06		0.787
Selective Prediction framework (A^2Search-7B, all UQ) 2026.06		0.773
Selective Prediction framework (Llama-3.1-8B, MI) 2026.06		0.763
Baseline (Llama-3.1-8B, MI) 2026.06		0.747
Baseline (A^2Search-7B, all UQ) 2026.06		0.742
Selective Prediction framework (A^2Search-7B, MI) 2026.06		0.482
Gated Experts model (A^2Search-7B, MI) 2026.06		0.48
Baseline (A^2Search-7B, MI) 2026.06		0.214