Title: Demystifying echo state network with deterministic simple topologies

Authors: Duaa Elsarraj; Maha Al Qisi; Ali Rodan; Nadim Obeid; Ahmad Sharieh; Hossam Faris

Addresses: King Abdulla II School for Information Technology, The University of Jordan, Amman, Jordan ' King Abdulla II School for Information Technology, The University of Jordan, Amman, Jordan ' King Abdulla II School for Information Technology, The University of Jordan, Amman, Jordan ' King Abdulla II School for Information Technology, The University of Jordan, Amman, Jordan ' King Abdulla II School for Information Technology, The University of Jordan, Amman, Jordan ' King Abdulla II School for Information Technology, The University of Jordan, Amman, Jordan

Abstract: Echo state networks (ESN) are a special type of recurrent neural networks (RNN) with distinct performance in the field of reservoir computing (RC). The state space of the ESN is initially randomised and the reservoir weights are fixed with training done only on the state readout. Beside the advantages of ESN, there remains some opacity in the dynamic properties of the reservoir due to the presence of randomisation. Our aim in this paper is to demystify the model of ESN in a complete deterministic structure with the use of different proposed reservoir structures (topologies) and compare their performance with the random ESN on different benchmark datasets. All applied topologies maintain the simplicity of random ESN computation complexity. Most of the topologies showed comparable or even better performance.

Keywords: echo state network; ESN; reservoir computing; reservoir structure topology; memory capacity; ESN algorithm; complexity.

DOI: 10.1504/IJCSE.2019.101349

International Journal of Computational Science and Engineering, 2019 Vol.19 No.3, pp.407 - 417

Received: 30 Jun 2016
Accepted: 15 Mar 2017
Published online: 05 Aug 2019 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article