LagerNVS: Latent Geometry for Fully Neural Real-time Novel View Synthesis

View PDF HTML (experimental)

Abstract:Recent work has shown that neural networks can perform 3D tasks such as Novel View Synthesis (NVS) without explicit 3D reconstruction. Even so, we argue that strong 3D inductive biases are still helpful in the design of such networks. We show this point by introducing LagerNVS, an encoder-decoder neural network for NVS that builds on 3D-aware' latent features. The encoder is initialized from a 3D reconstruction network pre-trained using explicit 3D supervision. This is paired with a lightweight decoder, and trained end-to-end with photometric losses. LagerNVS achieves state-of-the-art deterministic feed-forward Novel View Synthesis (including 31.4 PSNR on Re10k), with and without known cameras, renders in real time, generalizes to in-the-wild data, and can be paired with a diffusion decoder for generative extrapolation.

Comments: IEEE CVF Conference on Computer Vision and Pattern Recognition 2026. Project page with code, models and examples: this http URL

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as: arXiv:2603.20176 [cs.CV]

(or arXiv:2603.20176v2 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2603.20176

arXiv-issued DOI via DataCite

Submission history

From: Stanislaw Szymanowicz [view email] [v1] Fri, 20 Mar 2026 17:53:06 UTC (43,933 KB) [v2] Fri, 27 Mar 2026 16:23:25 UTC (45,649 KB)