Title: Dynamic parallel machine scheduling with random breakdowns using the learning agent

Authors: Biao Yuan; Zhibin Jiang; Lei Wang

Addresses: Department of Industrial Engineering & Management, Research Institute for Service Science & Enterprise Innovation, Shanghai Jiao Tong University, 800 Dong Chuan Road, Shanghai 200240, China ' Department of Industrial Engineering & Management, Research Institute for Service Science & Enterprise Innovation, Shanghai Jiao Tong University, 800 Dong Chuan Road, Shanghai 200240, China ' Department of Industrial Engineering & Management, Research Institute for Service Science & Enterprise Innovation, Shanghai Jiao Tong University, 800 Dong Chuan Road, Shanghai 200240, China

Abstract: Agent technology has been widely applied in the manufacturing process due to its flexibility, autonomy, and scalability. In this paper, the learning agent is proposed to solve a dynamic parallel machine scheduling problem which considers random breakdowns. The duty of the agent, which is based on the Q-learning algorithm, is to dynamically assign arriving jobs to idle machines according to the current state of its environment. A state-action table involving machine breakdowns is constructed to define the state of the agent's environment. Three rules, including SPT (Shortest Processing Time), EDD (Earliest Due Date) and FCFS (First Come First Served), are used as actions of the agent, and the ε-greedy policy is adopted by the agent to select an action. In the simulation experiment, two different objectives, including minimising the maximum lateness and minimising the percentage of tardy jobs, are utilised to validate the ability of the learning agent. The results demonstrate that the proposed agent is suitable for the complex parallel machine environment.

Keywords: parallel machine scheduling; dynamic scheduling; reinforcement learning; Q-learning; learning agent; machine breakdown; simulation; maximum lateness; tardy jobs; agent-based systems.

DOI: 10.1504/IJSOI.2016.080083

International Journal of Services Operations and Informatics, 2016 Vol.8 No.2, pp.94 - 103

Accepted: 28 Sep 2015
Published online: 01 Nov 2016 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article