Spatiotemporal System Forecasting with Irregular Time Steps via Masked Autoencoder

View PDF HTML (experimental)

Abstract:Predicting high-dimensional dynamical systems with irregular time steps presents significant challenges for current data-driven algorithms. These irregularities arise from missing data, sparse observations, or adaptive computational techniques, reducing prediction accuracy. To address these limitations, we propose a novel method: a Physics-Spatiotemporal Masked Autoencoder. This method integrates convolutional autoencoders for spatial feature extraction with masked autoencoders optimised for irregular time series, leveraging attention mechanisms to reconstruct the entire physical sequence in a single prediction pass. The model avoids the need for data imputation while preserving physical integrity of the system. Here, 'physics' refers to high-dimensional fields generated by underlying dynamical systems, rather than the enforcement of explicit physical constraints or PDE residuals. We evaluate this approach on multiple simulated datasets and real-world ocean temperature data. The results demonstrate that our method achieves significant improvements in prediction accuracy, robustness to nonlinearities, and computational efficiency over traditional convolutional and recurrent network methods. The model shows potential for capturing complex spatiotemporal patterns without requiring domain-specific knowledge, with applications in climate modelling, fluid dynamics, ocean forecasting, environmental monitoring, and scientific computing.

Subjects:

Machine Learning (cs.LG); Adaptation and Self-Organizing Systems (nlin.AO)

Cite as: arXiv:2603.25597 [cs.LG]

(or arXiv:2603.25597v1 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2603.25597

arXiv-issued DOI via DataCite (pending registration)

Journal reference: Physica D: Nonlinear Phenomena, 2026, 135189

Related DOI:

https://doi.org/10.1016/j.physd.2026.135189

DOI(s) linking to related resources

Submission history

From: Kewei Zhu [view email] [v1] Thu, 26 Mar 2026 16:14:11 UTC (5,673 KB)