Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Neural Uncertainty Principle: A Unified View of Adversarial Fragility and LLM Hallucination

About

Adversarial vulnerability in vision and hallucination in large language models are conventionally viewed as separate problems, each addressed with modality-specific patches. This study first reveals that they share a common geometric origin: the input and its loss gradient are conjugate observables subject to an irreducible uncertainty bound. Formalizing a Neural Uncertainty Principle (NUP) under a loss-induced state, we find that in near-bound regimes, further compression must be accompanied by increased sensitivity dispersion (adversarial fragility), while weak prompt-gradient coupling leaves generation under-constrained (hallucination). Crucially, this bound is modulated by an input-gradient correlation channel, captured by a specifically designed single-backward probe. In vision, masking highly coupled components improves robustness without costly adversarial training; in language, the same prefill-stage probe detects hallucination risk before generating any answer tokens. NUP thus turns two seemingly separate failure taxonomies into a shared uncertainty-budget view and provides a principled lens for reliability analysis. Guided by this NUP theory, we propose ConjMask (masking high-contribution input components) and LogitReg (logit-side regularization) to improve robustness without adversarial training, and use the probe as a decoding-free risk signal for LLMs, enabling hallucination detection and prompt selection. NUP thus provides a unified, practical framework for diagnosing and mitigating boundary anomalies across perception and generation tasks.

Dong-Xiao Zhang, Hu Lou, Jun-Jie Zhang, Jun Zhu, Deyu Meng• 2026

Related benchmarks

TaskDatasetResultRank
Image ClassificationCIFAR-10
Clean Accuracy89.5
12
Prefill-stage hallucination risk detectionBenchmark-500 Strict Consensus Pvote = 1.0 vs. Clean
AUROC (Mean)0.6939
4
Prefill-stage hallucination risk detectionBenchmark-500 Relaxed Consensus (Pvote ≥ 0.8)
AUROC (Mean)0.6957
4
Prompt SelectionPerturbation-100 (test)
Top-1 Hit76
4
Showing 4 of 4 rows

Other info

Follow for update