Stochastic Dimension Implicit Functional Projections for Exact Integral Conservation in High-Dimensional PINNs

View PDF HTML (experimental)

Abstract:Enforcing exact macroscopic conservation laws, such as mass and energy, in neural partial differential equation (PDE) solvers is computationally challenging in high dimensions. Traditional discrete projections rely on deterministic quadrature that scales poorly and restricts mesh-free formulations like PINNs. Furthermore, high-order operators incur heavy memory overhead, and generic optimization often lacks convergence guarantees for non-convex conservation manifolds. To address this, we propose the Stochastic Dimension Implicit Functional Projection (SDIFP) framework. Instead of projecting discrete vectors, SDIFP applies a global affine transformation to the continuous network output. This yields closed-form solutions for integral constraints via detached Monte Carlo (MC) quadrature, bypassing spatial grid dependencies. For scalable training, we introduce a doubly-stochastic unbiased gradient estimator (DS-UGE). By decoupling spatial sampling from differential operator subsampling, the DS-UGE reduces memory complexity from $\mathcal{O}(M \times N_{\mathcal{L}})$ to $\mathcal{O}(N \times |\mathcal{I}|)$. SDIFP mitigates sampling variance, preserves solution regularity, and maintains $\mathcal{O}(1)$ inference efficiency, providing a scalable, mesh-free approach for solving conservative high-dimensional PDEs.

Subjects:

Machine Learning (cs.LG); Numerical Analysis (math.NA)

Cite as: arXiv:2603.29237 [cs.LG]

(or arXiv:2603.29237v1 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2603.29237

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Zhangyong Liang [view email] [v1] Tue, 31 Mar 2026 04:07:51 UTC (545 KB)