PAD-Hand: Physics-Aware Diffusion for Hand Motion Recovery

View PDF HTML (experimental)

Abstract:Significant advancements made in reconstructing hands from images have delivered accurate single-frame estimates, yet they often lack physics consistency and provide no notion of how confidently the motion satisfies physics. In this paper, we propose a novel physics-aware conditional diffusion framework that refines noisy pose sequences into physically plausible hand motion while estimating the physics variance in motion estimates. Building on a MeshCNN-Transformer backbone, we formulate Euler-Lagrange dynamics for articulated hands. Unlike prior works that enforce zero residuals, we treat the resulting dynamic residuals as virtual observables to more effectively integrate physics. Through a last-layer Laplace approximation, our method produces per-joint, per-time variances that measure physics consistency and offers interpretable variance maps indicating where physical consistency weakens. Experiments on two well-known hand datasets show consistent gains over strong image-based initializations and competitive video-based methods. Qualitative results confirm that our variance estimations are aligned with the physical plausibility of the motion in image-based estimates.

Comments: Accepted to CVPR 2026

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as: arXiv:2603.26068 [cs.CV]

(or arXiv:2603.26068v2 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2603.26068

arXiv-issued DOI via DataCite

Submission history

From: Elkhan Ismayilzada [view email] [v1] Fri, 27 Mar 2026 04:39:21 UTC (2,937 KB) [v2] Mon, 30 Mar 2026 00:44:14 UTC (2,936 KB)