Designing Any Imaging System from Natural Language: Agent-Constrained Composition over a Finite Primitive Basis

View PDF HTML (experimental)

Abstract:Designing a computational imaging system -- selecting operators, setting parameters, validating consistency -- requires weeks of specialist effort per modality, creating an expertise bottleneck that excludes the broader scientific community from prototyping imaging instruments. We introduce this http URL, a structured specification format, and three autonomous agents -- Plan, Judge, and Execute -- that translate a one-sentence natural-language description into a validated forward model with bounded reconstruction error. A design-to-real error theorem decomposes total reconstruction error into five independently bounded terms, each linked to a corrective action. On 6 real-data modalities spanning all 5 carrier families, the automated pipeline matches expert-library quality (98.1 +/- 4.2%). Ten novel designs -- composing primitives into chains from 3D to 5D -- demonstrate compositional reach beyond any single-modality tool.

Comments: 28 pages, 7 figures, 8 tables, includes Supplementary Information (sections S1-S6)

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

MSC classes: 68U10, 65F22, 94A08

ACM classes: I.4.5; I.2.2; J.3

Cite as: arXiv:2603.25636 [cs.CV]

(or arXiv:2603.25636v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2603.25636

arXiv-issued DOI via DataCite

Submission history

From: Chengshuai Yang [view email] [v1] Thu, 26 Mar 2026 16:47:27 UTC (325 KB)