Neural Uncertainty Principle: A Unified View of Adversarial Fragility and LLM Hallucination
About
Adversarial vulnerability in vision and hallucination in large language models are conventionally viewed as separate problems, each addressed with modality-specific patches. This study first reveals that they share a common geometric origin: the input and its loss gradient are conjugate observables subject to an irreducible uncertainty bound. Formalizing a Neural Uncertainty Principle (NUP) under a loss-induced state, we find that in near-bound regimes, further compression must be accompanied by increased sensitivity dispersion (adversarial fragility), while weak prompt-gradient coupling leaves generation under-constrained (hallucination). Crucially, this bound is modulated by an input-gradient correlation channel, captured by a specifically designed single-backward probe. In vision, masking highly coupled components improves robustness without costly adversarial training; in language, the same prefill-stage probe detects hallucination risk before generating any answer tokens. NUP thus turns two seemingly separate failure taxonomies into a shared uncertainty-budget view and provides a principled lens for reliability analysis. Guided by this NUP theory, we propose ConjMask (masking high-contribution input components) and LogitReg (logit-side regularization) to improve robustness without adversarial training, and use the probe as a decoding-free risk signal for LLMs, enabling hallucination detection and prompt selection. NUP thus provides a unified, practical framework for diagnosing and mitigating boundary anomalies across perception and generation tasks.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Classification | CIFAR-10 | Clean Accuracy89.5 | 12 | |
| Prefill-stage hallucination risk detection | Benchmark-500 Strict Consensus Pvote = 1.0 vs. Clean | AUROC (Mean)0.6939 | 4 | |
| Prefill-stage hallucination risk detection | Benchmark-500 Relaxed Consensus (Pvote ≥ 0.8) | AUROC (Mean)0.6957 | 4 | |
| Prompt Selection | Perturbation-100 (test) | Top-1 Hit76 | 4 |