Wringe, Chester, Stepney, Susan orcid.org/0000-0003-3146-5401 and Trefzer, Martin Albrecht orcid.org/0000-0002-6196-6832 (2024) Modelling and evaluating restricted ESNs on single- and multi-timescale problems. Natural Computing. ISSN 1567-7818
Abstract
Reservoir Computing is a computing model ideal for performing computation on varied physical substrates. However, these physical reservoirs can be difficult to scale up. We propose joining various reservoirs together as an approach to solving this problem, simulating physical reservoirs with Echo State Networks (ESNs). We investigate various methods of combining ESNs to form larger reservoirs, including a method that we dub Restricted ESNs. We provide a notation for describing Restricted ESNs, and use it to benchmark a standard ESN against restricted ones. We investigate two methods to keep the weight matrix density consistent when comparing a Restricted ESN to a standard one, which we call overall consistency and patch consistency. We benchmark restricted ESNs on NARMA10 and the sunspot prediction benchmark, and find that restricted ESNs perform similarly to standard ones. We present some application scenarios in which restricted ESNs may offer advantages over standard ESNs. We then test restricted ESNs on a version of the multi-timescale Multiple Superimposed Sines tasks, in order to establish a baseline performance that can be improved upon in further work. We conclude that we can scale up reservoir performance by linking small homogeneous subreservoirs together without significant loss in performance over a single large reservoir, justifying future work on using heterogeneous subreservoirs for greater flexibility.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © The Author(s) 2024 |
Keywords: | reservoir computing,unconventional computing,in-materio computing,Multi-timescale |
Dates: |
|
Institution: | The University of York |
Academic Units: | The University of York > Faculty of Sciences (York) > Electronic Engineering (York) The University of York > Faculty of Sciences (York) > Computer Science (York) |
Depositing User: | Pure (York) |
Date Deposited: | 30 Oct 2024 09:00 |
Last Modified: | 23 Jan 2025 00:36 |
Published Version: | https://doi.org/10.1007/s11047-024-10004-7 |
Status: | Published online |
Refereed: | Yes |
Identification Number: | 10.1007/s11047-024-10004-7 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:218912 |