Clustered and deep echo state networks for signal noise reduction

作者:Laercio de Oliveira Junior, Florian Stelzer, Liang Zhao

摘要

Echo State Networks (ESNs) are Recurrent Neural Networks with fixed input and internal (hidden) weights, and adaptable output weights. The hidden part of an ESN can be considered as a discrete-time dynamical system, called reservoir. In classical ESNs, the internal connections are obtained from an Erdős-Rényi graph. A recent study proposed ESNs with clustered adjacency matrices (CESNs), where the clusters are either Erdős-Rényi graphs or Barabási-Albert-like graphs. In this work, we investigate the effectiveness of CESNs and apply them for signal denoising. In addition, we introduce and study deep CESNs with multiple clustered layers. We found that CESNs and deep CESNs can compete with deep ESNs for all tasks that we considered.

论文关键词:Echo state networks, Reservoir computing, Complex networks, Noise reduction

论文评审过程:

论文官网地址:https://doi.org/10.1007/s10994-022-06135-6