Reconstruct Anything Model: a lightweight general model for computational imaging

View PDF HTML (experimental)

Abstract:Most existing learning-based methods for solving imaging inverse problems can be roughly divided into two classes: iterative algorithms, such as plug-and-play and diffusion methods leveraging pretrained denoisers, and unrolled architectures that are trained end-to-end for specific imaging problems. Iterative methods in the first class are computationally costly and often yield suboptimal reconstruction performance, whereas unrolled architectures are generally problem-specific and require expensive training. In this work, we propose a novel non-iterative, lightweight architecture that incorporates knowledge about the forward operator (acquisition physics and noise parameters) without relying on unrolling. Our model is trained to solve a wide range of inverse problems, such as deblurring, magnetic resonance imaging, computed tomography, inpainting, and super-resolution, and handles arbitrary image sizes and channels, such as grayscale, complex, and color data. The proposed model can be easily adapted to unseen inverse problems or datasets with a few fine-tuning steps (up to a few images) in a self-supervised way, without ground-truth references. Throughout a series of experiments, we demonstrate state-of-the-art performance from medical imaging to low-photon imaging and microscopy. Our code is available at this https URL.

Subjects:

Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

Cite as: arXiv:2503.08915 [eess.IV]

(or arXiv:2503.08915v4 [eess.IV] for this version)

https://doi.org/10.48550/arXiv.2503.08915

arXiv-issued DOI via DataCite

Submission history

From: Matthieu Terris [view email] [v1] Tue, 11 Mar 2025 21:53:58 UTC (28,655 KB) [v2] Mon, 14 Apr 2025 09:44:57 UTC (46,642 KB) [v3] Sat, 27 Sep 2025 09:29:14 UTC (40,629 KB) [v4] Sun, 29 Mar 2026 10:22:33 UTC (42,070 KB)