Neural Uncertainty Principle: A Unified View of Adversarial Fragility and LLM Hallucination

View PDF HTML (experimental)

Abstract:Adversarial vulnerability in vision and hallucination in large language models are conventionally viewed as separate problems, each addressed with modality-specific patches. This study first reveals that they share a common geometric origin: the input and its loss gradient are conjugate observables subject to an irreducible uncertainty bound. Formalizing a Neural Uncertainty Principle (NUP) under a loss-induced state, we find that in near-bound regimes, further compression must be accompanied by increased sensitivity dispersion (adversarial fragility), while weak prompt-gradient coupling leaves generation under-constrained (hallucination). Crucially, this bound is modulated by an input-gradient correlation channel, captured by a specifically designed single-backward probe. In vision, masking highly coupled components improves robustness without costly adversarial training; in language, the same prefill-stage probe detects hallucination risk before generating any answer tokens. NUP thus turns two seemingly separate failure taxonomies into a shared uncertainty-budget view and provides a principled lens for reliability analysis. Guided by this NUP theory, we propose ConjMask (masking high-contribution input components) and LogitReg (logit-side regularization) to improve robustness without adversarial training, and use the probe as a decoding-free risk signal for LLMs, enabling hallucination detection and prompt selection. NUP thus provides a unified, practical framework for diagnosing and mitigating boundary anomalies across perception and generation tasks.

Comments: 16 pages,3 figures

Subjects:

Machine Learning (cs.LG); Information Theory (cs.IT); Computational Physics (physics.comp-ph)

Cite as: arXiv:2603.19562 [cs.LG]

(or arXiv:2603.19562v3 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2603.19562

arXiv-issued DOI via DataCite

Submission history

From: Jun-Jie Zhang [view email] [v1] Fri, 20 Mar 2026 02:07:10 UTC (3,390 KB) [v2] Thu, 26 Mar 2026 10:40:29 UTC (3,393 KB) [v3] Fri, 27 Mar 2026 04:47:21 UTC (3,443 KB)