Beyond Freshness and Semantics: A Coupon-Collector Framework for Effective Status Updates

View PDF HTML (experimental)

Abstract:For status update systems operating over unreliable energy-constrained wireless channels, we address Weaver's long-standing Level-C question: do my packets actually improve the plant's behavior? Each fresh sample carries a stochastic expiration time -- governed by the plant's instability dynamics -- after which the information becomes useless for control. Casting the problem as a coupon-collector variant with expiring coupons, we (i) formulate a two-dimensional average-reward MDP, (ii) prove that the optimal schedule is doubly thresholded in the receiver's freshness timer and the sender's stored lifetime, (iii) derive a closed-form policy for deterministic lifetimes, and (iv) design a Structure-Aware Q-learning algorithm (SAQ) that learns the optimal policy without knowing the channel success probability or lifetime distribution. Simulations validate our theoretical predictions: SAQ matches optimal Value Iteration performance while converging significantly faster than baseline Q-learning, and expiration-aware scheduling achieves up to 50% higher reward than age-based baselines by adapting transmissions to state-dependent urgency -- thereby delivering Level-C effectiveness under tight resource constraints.

Comments: 12 pages, 5 figures, extended version of a paper accepted to WiOpt 2026

Subjects:

Systems and Control (eess.SY); Information Theory (cs.IT); Machine Learning (cs.LG)

MSC classes: 90C40, 93E20

Cite as: arXiv:2603.26998 [eess.SY]

(or arXiv:2603.26998v1 [eess.SY] for this version)

https://doi.org/10.48550/arXiv.2603.26998

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Youssef Ahmed [view email] [v1] Fri, 27 Mar 2026 21:19:08 UTC (133 KB)