Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ANCHOR: Abductive Network Construction with Hierarchical Orchestration for Reliable Probability Inference in Large Language Models

About

A central challenge in large-scale decision-making under incomplete information is estimating reliable probabilities. Recent approaches use Large Language Models (LLMs) to generate explanatory factors and coarse-grained probability estimates, which are then refined by a Na\"ive Bayes model over factor combinations. However, sparse factor spaces often yield ``unknown'' predictions, while expanding factors increases noise and spurious correlations, weakening conditional independence and degrading reliability. To address these limitations, we propose \textsc{Anchor}, an aggregated Bayesian inference framework over a hierarchical factor space. It constructs dense factor hierarchies through iterative generation and clustering, maps contexts via hierarchical retrieval and refinement, and augments Na\"ive Bayes with a Causal Bayesian Network to model latent factor dependencies. Experiments show that \textsc{Anchor} markedly reduces ``unknown'' predictions and produces more reliable probability estimates than direct LLM baselines, achieving state-of-the-art performance while significantly reducing time and token overhead.

Wentao Qiu, Guanran Luo, Zhongquan Jian, Jingqi Gao, Meihong Wang, Qingqiang Wu• 2026

Related benchmarks

TaskDatasetResultRank
Fact CheckingCOVID-Fact
Balanced Acc72.6
32
Fact CheckingExpertQA
Balanced Accuracy61.1
25
Pairwise Preference EvaluationCOMMON2SENSE
Context 1 Preference Score61
21
Fact CheckingXsum
Balanced Accuracy56.4
10
Fact Checkingcnn
Balanced Accuracy62.1
10
Reasoning/PlanningTODAY
Accuracy81.7
10
Reasoning/PlanningPLASMA
Accuracy76.4
10
Showing 7 of 7 rows

Other info

Follow for update