Title: Reinforcement learning-based real time search algorithm for routing optimisation in wireless sensor networks using fuzzy link cost estimation

Authors: Kuldeep Singh; Jyoteesh Malhotra

Addresses: Department of ECE, Guru Nanak Dev University Regional Campus, Sultanpur Lodhi, Punjab, India ' Department of ECE, Guru Nanak Dev University Regional Campus, Jalandhar, Punjab, India

Abstract: Internet of things is a technological advancement of wireless sensor networks (WSNs) which are characterised by highly complex, large scale, heterogeneous, dynamically changing and asymmetric networks. Such constraints make routing in WSNs a difficult task. This paper introduces fuzzy link cost estimation-based real time search routing algorithm (fuzzy RTS) in which link cost estimation is obtained from physical and MAC layer parameters like residual energy, packet drop rate and RSSI. Its performance has been evaluated with traditional reinforcement learning-based algorithms like real time search, adaptive tree, ant routing and constrained flooding algorithms on the basis of metrics like throughput, loss rate, success rate, energy consumption, energy efficiency and node battery life. The simulation results reveal that fuzzy RTS algorithm is most appropriate reinforcement learning-based routing algorithm among given algorithms for ensuring energy efficient and QoS aware routing in dynamically changing, asymmetric and unreliable environment of WSNs.

Keywords: internet of things; IoTs; wireless sensor networks; WSNs; search algorithm; fuzzy logic; link cost; reinforcement learning.

DOI: 10.1504/IJCNDS.2019.099967

International Journal of Communication Networks and Distributed Systems, 2019 Vol.22 No.4, pp.363 - 384

Received: 06 Apr 2017
Accepted: 07 Mar 2018
Published online: 03 Jun 2019 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article