Authors: Jonathan Wildstrom, Peter Stone, Emmett Witchel
Addresses: Department of Computer Sciences, The University of Texas at Austin, 1 University Station C0500, Austin, Texas 78712-0233, USA. ' Department of Computer Sciences, The University of Texas at Austin, 1 University Station C0500, Austin, Texas 78712-0233, USA. ' Department of Computer Sciences, The University of Texas at Austin, 1 University Station C0500, Austin, Texas 78712-0233, USA
Abstract: As the use of virtualisation and partitioning grows, it becomes possible to deploy a multi-tier web-based application with a variable amount of computing power. This introduces the possibility of provisioning only for a minimum workload, with the intention of renting more resources as necessary, but it also creates the problem of quickly and accurately identifying when more resources are needed or unneeded resources are being paid for. This paper presents a machine learning based approach to handling this problem. An autonomous adaptive agent learns to predict the gain (or loss) that would result from more (or less) resources; this agent uses only low-level system statistics, rather than relying on custom instrumentation of the operating system or middleware. Our agent is fully implemented and evaluated on a publicly available multi-machine, multi-process distributed system (the online transaction processing benchmark TPC-W). We show that our adaptive agent is competitive with any static choice of computing resources over a variety of test workloads. We also show that the agent outperforms each static choice in at least one case, implying that it is well suited for a situation where the workload is unknown.
Keywords: resource allocation; virtualisation; machine learning; supervised learning; autonomic computing; autonomous agents; distributed systems; online transactions; computing resources; return on investment; ROI; additional processing resources.
International Journal of Autonomic Computing, 2010 Vol.1 No.3, pp.280 - 296
Published online: 06 May 2010 *Full-text access for editors Access for subscribers Purchase this article Comment on this article