Computer Science > Machine Learning

arXiv:2602.03912 (cs)

[Submitted on 3 Feb 2026 (v1), last revised 30 Mar 2026 (this version, v2)]

Title:Echo State Networks for Time Series Forecasting: Hyperparameter Sweep and Benchmarking

Authors:Alexander Häußer View a PDF of the paper titled Echo State Networks for Time Series Forecasting: Hyperparameter Sweep and Benchmarking, by Alexander H"au{\ss}er View PDF

Abstract:This paper investigates the forecasting performance of Echo State Networks (ESNs) for univariate time series forecasting using a subset of the M4 Forecasting Competition dataset. Focusing on monthly and quarterly time series with at most 20 years of historical data, we evaluate whether a fully automatic, purely feedback-driven ESN can serve as a competitive alternative to widely used statistical forecasting methods. The study adopts a rigorous two-stage evaluation approach: a Parameter dataset is used to conduct an extensive hyperparameter sweep covering leakage rate, spectral radius, reservoir size, and information criteria for regularization, resulting in over four million ESN model fits; a disjoint Forecast dataset is then used for out-of-sample accuracy assessment. Forecast accuracy is measured using MASE and sMAPE and benchmarked against simple benchmarks like drift and seasonal naive and statistical models like ARIMA, ETS, and TBATS. The hyperparameter analysis reveals consistent and interpretable patterns, with monthly series favoring moderately persistent reservoirs and quarterly series favoring more contractive dynamics. Across both frequencies, high leakage rates are preferred, while optimal spectral radii and reservoir sizes vary with temporal resolution. In the out-of-sample evaluation, the ESN performs on par with ARIMA and TBATS for monthly data and achieves the lowest mean MASE for quarterly data, while requiring lower computational cost than the more complex statistical models. Overall, the results demonstrate that ESNs offer a compelling balance between predictive accuracy, robustness, and computational efficiency, positioning them as a practical option for automated time series forecasting.

Subjects:

Machine Learning (cs.LG)

Cite as: arXiv:2602.03912 [cs.LG]

(or arXiv:2602.03912v2 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2602.03912

Focus to learn more

arXiv-issued DOI via DataCite

Submission history

From: Alexander Häußer [view email] [v1] Tue, 3 Feb 2026 16:01:22 UTC (107 KB) [v2] Mon, 30 Mar 2026 12:39:28 UTC (108 KB)

Full-text links:

Access Paper:

View a PDF of the paper titled Echo State Networks for Time Series Forecasting: Hyperparameter Sweep and Benchmarking, by Alexander H"au{\ss}er

• View PDF
• TeX Source view license

Current browse context: cs.LG

< prev

|   next >

new | recent | 2026-02

Change to browse by:

cs

References & Citations

• NASA ADS

• Google Scholar

• Semantic Scholar

export BibTeX citation Loading...

Bookmark

Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

Links to Code Toggle

Papers with Code (What is Papers with Code?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

IArxiv recommender toggle

IArxiv Recommender (What is IArxiv?)

• Author

• Venue

• Institution

• Topic

About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)