vix.ing · top · new · best · stats · spec

Reducing hyperparameter dependence by external timescale tailoring

2023/07/17 by Lina Jaurigue, Jaurigue, Lina C., Kathy Lüdge +1 · 2 citations
Computer Science · Engineering · #Advanced Memory and Neural Computing #Computational Physics (physics.comp-ph) #FOS: Computer and information sciences #FOS: Physical sciences #Neural Networks and Applications #Neural Networks and Reservoir Computing #Neural and Evolutionary Computing (cs.NE)

paper · pdf · doi:10.48550/arxiv.2307.08603

openalex publication_date 2023/07/17 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Task specific hyperparameter tuning in reservoir computing is an open issue, and is of particular relevance for hardware implemented reservoirs. We investigate the influence of directly including externally controllable task specific timescales on the performance and hyperparameter sensitivity of reservoir computing approaches. We show that the need for hyperparameter optimisation can be reduced if timescales of the reservoir are tailored to the specific task. Our results are mainly relevant for temporal tasks requiring memory of past inputs, for example chaotic timeseries prediciton. We consider various methods of including task specific timescales in the reservoir computing approach and demonstrate the universality of our message by looking at both time-multiplexed and spatially multiplexed reservoir computing.

Cited by

Related