SHARP: Short-Window Streaming for Accurate and Robust Prediction in Motion Forecasting

View PDF HTML (experimental)

Abstract:In dynamic traffic environments, motion forecasting models must be able to accurately estimate future trajectories continuously. Streaming-based methods are a promising solution, but despite recent advances, their performance often degrades when exposed to heterogeneous observation lengths. To address this, we propose a novel streaming-based motion forecasting framework that explicitly focuses on evolving scenes. Our method incrementally processes incoming observation windows and leverages an instance-aware context streaming to maintain and update latent agent representations across inference steps. A dual training objective further enables consistent forecasting accuracy across diverse observation horizons. Extensive experiments on Argoverse 2, nuScenes, and Argoverse 1 demonstrate the robustness of our approach under evolving scene conditions and also on the single-agent benchmarks. Our model achieves state-of-the-art performance in streaming inference on the Argoverse 2 multi-agent benchmark, while maintaining minimal latency, highlighting its suitability for real-world deployment.

Comments: CVPR 2026. Project page at this https URL

Subjects:

Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

Cite as: arXiv:2603.28091 [cs.CV]

(or arXiv:2603.28091v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2603.28091

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Alexander Prutsch [view email] [v1] Mon, 30 Mar 2026 06:47:19 UTC (4,746 KB)