The Dual-State Architecture for Reliable LLM Agents

View PDF HTML (experimental)

Abstract:Large Language Models deployed as code generation agents exhibit stochastic behavior incompatible with the deterministic guarantees required by software engineering. We formalize the Dual-State Action Pair (DSAP), an execution primitive that couples stochastic generation with deterministic post-condition verification. Guard functions act as sensing actions that project opaque LLM outputs onto observable workflow state, enabling a dual-state decomposition: finite, deterministic S_workflow paired with infinite, stochastic S_env. We prove that for epsilon-capable generators, failure probability P(fail) <= (1-epsilon)^R_max -> 0. To prevent naive O(R^K) retry explosion across multi-step workflows, we introduce a three-level recovery hierarchy: context refinement (retry within step), informed backtracking (stagnation detection with cascade invalidation and context injection to upstream steps), and human escalation. Experimental validation across 13 LLMs (1.3B-15B parameters) on three diagnostic probes demonstrates reliability gains of up to 66 percentage points at 1.2-2.1x baseline cost. Recovery mechanism evaluation on 99 SWE-Bench Pro instance-arm pairs (Qwen3-Coder-Next) demonstrates 100% context injection effectiveness (upstream output changed in all 71 escalation events) with step-specific recovery asymmetry -- 37.5% for test generation vs. 0% for patch generation -- and 0% end-to-end patch production, establishing the boundary between execution architecture and plan synthesis: execution recovery is necessary but not sufficient for autonomous software engineering.

Comments: 18 pages, 2 figures, 5 tables. V2 extends and supersedes V1, introducing tri-state guard semantics, a three-level recovery hierarchy, and SWE-Bench boundary analysis

Subjects:

Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Software Engineering (cs.SE)

Cite as: arXiv:2512.20660 [cs.LG]

(or arXiv:2512.20660v2 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2512.20660

arXiv-issued DOI via DataCite

Submission history

From: Matthew Thompson Mr [view email] [v1] Thu, 18 Dec 2025 15:28:21 UTC (151 KB) [v2] Fri, 27 Mar 2026 10:57:33 UTC (18 KB)