Polarization-Based Eye Tracking with Personalized Siamese Architectures

View PDF HTML (experimental)

Abstract:Head-mounted devices integrated with eye tracking promise a solution for natural human-computer interaction. However, they typically require per-user calibration for optimal performance due to inter-person variability. A differential personalization approach using Siamese architectures learns relative gaze displacements and reconstructs absolute gaze from a small set of calibration frames. In this paper, we benchmark Siamese personalization on polarization-enabled eye tracking. For benchmarking, we use a 338-subject dataset captured with a polarization-sensitive camera and 850 nm illumination. We achieve performance comparable to linear calibration with 10-fold fewer samples. Using polarization inputs for Siamese personalization reduces gaze error by up to 12% compared to near-infrared (NIR)-based inputs. Combining Siamese personalization with linear calibration yields further improvements of up to 13% over a linearly calibrated baseline. These results establish Siamese personalization as a practical approach enabling accurate eye tracking.

Comments: Accepted to ETRA 2026 as full paper

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

MSC classes: 68T07, 68T45

ACM classes: H.5.2; I.2.10; I.4.8; I.5.4

Cite as: arXiv:2603.25889 [cs.CV]

(or arXiv:2603.25889v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2603.25889

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Mantas Zurauskas [view email] [v1] Thu, 26 Mar 2026 20:24:12 UTC (1,668 KB)