Performance boost of time-delay reservoir computing by non-resonant clock cycle
May 07, 2019 Β· Declared Dead Β· π Neural Networks
"No code URL or promise found in abstract"
Evidence collected by the PWNC Scanner
Authors
Florian Stelzer, AndrΓ© RΓΆhm, Kathy LΓΌdge, Serhiy Yanchuk
arXiv ID
1905.02534
Category
nlin.AO
Cross-listed
cs.LG,
cs.NE,
math.DS
Citations
54
Venue
Neural Networks
Last Checked
3 months ago
Abstract
The time-delay-based reservoir computing setup has seen tremendous success in both experiment and simulation. It allows for the construction of large neuromorphic computing systems with only few components. However, until now the interplay of the different timescales has not been investigated thoroughly. In this manuscript, we investigate the effects of a mismatch between the time-delay and the clock cycle for a general model. Typically, these two time scales are considered to be equal. Here we show that the case of equal or resonant time-delay and clock cycle could be actively detrimental and leads to an increase of the approximation error of the reservoir. In particular, we can show that non-resonant ratios of these time scales have maximal memory capacities. We achieve this by translating the periodically driven delay-dynamical system into an equivalent network. Networks that originate from a system with resonant delay-times and clock cycles fail to utilize all of their degrees of freedom, which causes the degradation of their performance.
Community Contributions
Found the code? Know the venue? Think something is wrong? Let us know!
π Similar Papers
In the same crypt β nlin.AO
R.I.P.
π»
Ghosted
R.I.P.
π»
Ghosted
When slower is faster
R.I.P.
π»
Ghosted
Seeking Open-Ended Evolution in Swarm Chemistry II: Analyzing Long-Term Dynamics via Automated Object Harvesting
R.I.P.
π»
Ghosted
Self-Organization and Artificial Life
R.I.P.
π»
Ghosted
Using Machine Learning to Assess Short Term Causal Dependence and Infer Network Links
R.I.P.
π»
Ghosted
Machine Learning Link Inference of Noisy Delay-coupled Networks with Opto-Electronic Experimental Tests
Died the same way β π» Ghosted
R.I.P.
π»
Ghosted
Neural Architecture Search with Reinforcement Learning
R.I.P.
π»
Ghosted
Federated Learning: Strategies for Improving Communication Efficiency
R.I.P.
π»
Ghosted
In-Datacenter Performance Analysis of a Tensor Processing Unit
R.I.P.
π»
Ghosted