Title: A smart proactive routing protocol in cognitive radio networks

Authors: Mahsa Soheil Shamaee; Mohammad Ebrahim Shiri; Masoud Sabaei

Addresses: Department of Mathematics and Computer Science, Amirkabir University of Technology, Tehran, 0098, Iran ' Department of Mathematics and Computer Science, Amirkabir University of Technology, Tehran, 0098, Iran ' Department of Computer Engineering and Information Technology, Amirkabir University of Technology, Tehran, 0098, Iran

Abstract: In this paper, we introduce a smart proactive routing protocol based on the Q-learning algorithm to find the most stable routes which imposes a minimum interference on the primary users. Unlike traditional proactive routing protocols, in our proposed method control packets are not broadcast whenever the network topology changes. Indeed, we apply a generalised version of Q-learning to predict the model of the routes stability. This model is used to prevent the flood of state information that is ineffective for routing decisions. The frequency of changes in the model is much less than that in the network topology. In the new approach, secondary users broadcast control packets following any changes in the model which reduces the routing overhead. Evaluation of the simulation results show that our routing protocol outperforms existing schemes in terms of throughput and the interference imposed on the primary users' spectrum as well as routing overhead.

Keywords: proactive routing; routes stability; control overhead; Q-learning; reinforcement learning; cognitive radio; primary users; secondary users; opportunistically access; channel availability.

DOI: 10.1504/IJAHUC.2019.100081

International Journal of Ad Hoc and Ubiquitous Computing, 2019 Vol.31 No.2, pp.83 - 102

Received: 26 Jan 2017
Accepted: 02 Aug 2017
Published online: 07 Jun 2019 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article