Title: A unified multiple-level cache for high performance storage systems

Authors: Xubin (Ben) He, Li Ou, Martha J. Kosa, Stephen L. Scott, Christian Engelmann

Addresses: Department of Electrical and Computer Engineering, Tennessee Technological University, Cookeville, TN 38505, USA. ' Department of Electrical and Computer Engineering, Tennessee Technological University, Cookeville, TN 38505, USA. ' Department of Computer Science, Tennessee Technological University, Cookeville, TN 38505, USA. ' Computer Science and Mathematics Division, Oak Ridge National Laboratory, Oak Ridge, TN 37831, USA. ' Computer Science and Mathematics Division, Oak Ridge National Laboratory, Oak Ridge, TN 37831, USA

Abstract: Multi-level cache hierarchies are widely used in high-performance storage systems to improve I/O performance. However, traditional cache management algorithms are not suited well for such cache organisations. Recently proposed multi-level cache replacement algorithms using aggressive exclusive caching work well with single or multiple-client, low-correlated workloads, but suffer serious performance degradation with multiple-client, high-correlated workloads. In this paper, we propose a new cache management algorithm that handles multi-level buffer caches by forming a unified cache (uCache), which uses both exclusive caching in L2 storage caches and cooperative client caching. We also propose a new local replacement algorithm, Frequency Based Eviction-Reference (FBER), based on our study of access patterns in exclusive caches. Our simulation results show that uCache increases the cumulative cache hit ratio dramatically. Compared to other popular cache algorithms, such as LRU, the I/O response time is improved by up to 46% for low-correlated workloads and 53% for high-correlated workloads.

Keywords: cooperative caches; multi-level cache; distributed I/O; storage systems; input-output performance; cache management.

DOI: 10.1504/IJHPCN.2007.015768

International Journal of High Performance Computing and Networking, 2007 Vol.5 No.1/2, pp.97 - 109

Published online: 14 Nov 2007 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article