Title: The modelling of Markovian decision processes: two applications in China

Authors: Liu Ke

Addresses: Institute of Applied Mathematics, Academia Sinica, Beijing, China

Abstract: Markovian decision processes are introduced in this paper. In particular, it is shown how to model a real problem on Markovian decision processes in China. There are two real applications in this paper: one is a reservoir control problem and the other is a machine maintenance problem.

Keywords: Markov processes; optimal policy; hydropower stations; machine maintenance; China; decision making; reservoir control; modelling; optimisation.

DOI: 10.1504/IJCEELL.1994.030289

International Journal of Continuing Engineering Education and Life-Long Learning, 1994 Vol.4 No.1/2, pp.50 - 57

Published online: 14 Dec 2009 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article