From Foundation ECG Models to NISQ Learners: Distilling ECGFounder into a VQC Student

View PDF HTML (experimental)

Abstract:Foundation models have recently improved electrocardiogram (ECG) representation learning, but their deployment can be limited by computational cost and latency constraints. In this work, we fine-tune ECGFounder as a high-capacity teacher for binary ECG classification on PTB-XL and the MIT-BIH Arrhythmia Database, and investigate whether knowledge distillation can transfer its predictive behavior to compact students. We evaluate two classical 1D students (ResNet-1D and a lightweight CNN-1D) and a quantum-ready pipeline that combines a convolutional autoencoder, which compresses 256-sample ECG windows into a low-dimensional latent representation, with a 6-qubit variational quantum circuit implemented in Qiskit and executed in a simulated backend. Across both datasets, the teacher provides the strongest overall performance, while distillation yields competitive students under a considerable reduction in trainable parameters. We further analyze the sensitivity of student performance to distillation settings, highlighting consistent accuracy--efficiency trade-offs when compressing a foundation ECG model into classical and quantum-ready learners under a unified evaluation protocol.

Subjects:

Quantum Physics (quant-ph); Artificial Intelligence (cs.AI)

Cite as: arXiv:2603.27269 [quant-ph]

(or arXiv:2603.27269v1 [quant-ph] for this version)

https://doi.org/10.48550/arXiv.2603.27269

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Felipe Mahlow [view email] [v1] Sat, 28 Mar 2026 13:36:45 UTC (2,918 KB)