Title: Reward processes and performance simulation in supermarket models with different servers

Authors: Quan-Lin Li; Feifei Yang; Na Li

Addresses: School of Economics and Management Sciences, Yanshan University, Qinhuangdao 066004, China ' School of Economics and Management Sciences, Yanshan University, Qinhuangdao 066004, China ' Department of Industrial Engineering and Management, Shanghai Jiaotong University, Shanghai 200240, China

Abstract: Supermarket models with different servers have become a key in modelling resource management of stochastic networks, such as computer networks, manufacturing systems, transportation networks, and healthcare systems. However, the different servers always make analysis of such a supermarket model more interesting, difficult and challenging. This paper provides a novel method for analysing the supermarket models with different servers through a multi-dimensional continuous-time Markov reward process. Firstly, some utility functions are constructed for designing the routine selection mechanism according to the queue lengths, the service rates, and the probability of individual preference. Secondly, using the state jump points of the continuous-time Markov reward process, some segmented stochastic integrals of the random reward function are established by means of an event-driven technique. Based on this, the mean of the random reward function in a finite time interval is computed, and the mean of the discounted random reward function in an infinite time interval can also be calculated. Finally, some simulation experiments are given to indicate how the expected queue length of each server depends on some key parameters of this supermarket model.

Keywords: supermarkets; routine selection mechanism; Markov reward process; stochastic integral; event-driven technique; performance simulation; supermarket models; different servers; modelling; resource management; queue lengths; service rates; individual preferences.

DOI: 10.1504/IJSPM.2016.078509

International Journal of Simulation and Process Modelling, 2016 Vol.11 No.3/4, pp.192 - 206

Received: 28 Apr 2015
Accepted: 13 Dec 2015

Published online: 22 Aug 2016 *

Full-text access for editors Access for subscribers Purchase this article Comment on this article