Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory

View PDF HTML (experimental)

Abstract:Standard evaluation of LLM confidence relies on calibration metrics (ECE, Brier score) that conflate two distinct capacities: how much a model knows (Type-1 sensitivity) and how well it knows what it knows (Type-2 metacognitive sensitivity). We introduce an evaluation framework based on Type-2 Signal Detection Theory that decomposes these capacities using meta-d' and the metacognitive efficiency ratio M-ratio. Applied to four LLMs (Llama-3-8B-Instruct, Mistral-7B-Instruct-v0.3, Llama-3-8B-Base, Gemma-2-9B-Instruct) across 224,000 factual QA trials, we find: (1) metacognitive efficiency varies substantially across models even when Type-1 sensitivity is similar -- Mistral achieves the highest d' but the lowest M-ratio; (2) metacognitive efficiency is domain-specific, with different models showing different weakest domains, invisible to aggregate metrics; (3) temperature manipulation shifts Type-2 criterion while meta-d' remains stable for two of four models, dissociating confidence policy from metacognitive capacity; (4) AUROC_2 and M-ratio produce fully inverted model rankings, demonstrating these metrics answer fundamentally different evaluation questions. The meta-d' framework reveals which models "know what they don't know" versus which merely appear well-calibrated due to criterion placement -- a distinction with direct implications for model selection, deployment, and human-AI collaboration. Pre-registered analysis; code and data publicly available.

Comments: 12 pages, 3 figures, 7 tables. Pre-registered; code and data at this https URL

Subjects:

Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

ACM classes: I.2.7; I.5.1

Cite as: arXiv:2603.25112 [cs.CL]

(or arXiv:2603.25112v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2603.25112

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Jon-Paul Cacioli [view email] [v1] Thu, 26 Mar 2026 07:38:28 UTC (566 KB)