Title: Towards optimisation of replicated erasure codes for efficient cooperative repair in cloud storage systems

Authors: Guangping Xu; Qunfang Mao; Huan Li; Shengli Li

Addresses: Tianjin Key Lab. of Intelligence Computing and New Software Technology, School of Computer and Communication Engineering, Tianjin University of Technology, Tianjin 300384, China ' Tianjin Key Lab. of Intelligence Computing and New Software Technology, School of Computer and Communication Engineering, Tianjin University of Technology, Tianjin 300384, China ' Tianjin Key Lab. of Intelligence Computing and New Software Technology, School of Computer and Communication Engineering, Tianjin University of Technology, Tianjin 300384, China ' Tianjin IC Card Public Network System Co. Ltd., Tianjin, 300384, China

Abstract: The study of erasure codes in distributed storage systems has two aspects: one is to reduce the data redundancy and the other one is to save the bandwidth cost during repair process. Repair-efficient codes are investigated to improve the repair performance. However the researches are mostly in theoretical stage and hardly applied in the practical distributed storage systems like cloud storage. In this paper, we present a unified framework to describe some repair-efficient regenerating codes in order to reduce the bandwidth cost in regenerating the lost data. We build an evaluation system to measure the performance of these codes during file encoding, file decoding and individual failure repairing with given feasible parameters. By the experimental comparison and analysis, we validate that the repair-efficient regenerating codes can significantly save much more repair time than traditional erasure codes during repair process at the same storage cost; in particular, some replication-based erasure codes can perform better than others in some certain cases. Our experiments can help researchers to decide which kind of erasure codes to use in building distributed storage systems.

Keywords: erasure codes; distributed storage systems; data recovery; repair-efficient codes.

DOI: 10.1504/IJCSE.2018.090444

International Journal of Computational Science and Engineering, 2018 Vol.16 No.2, pp.108 - 116

Received: 16 Jan 2016
Accepted: 13 Mar 2016
Published online: 19 Mar 2018 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article