Title: Peer-to-peer storage engine for schemaless immutable data
Authors: José Ghislain Quenum; Alexander Brown Shipena
Addresses: Namibia University of Science and Technology, Windhoek, Namibia ' Motor Vehicle Accident Fund, Windhoek, Namibia
Abstract: We present TaYo, a peer-to-peer storage engine explicitly designed for immutable data which bypasses the file system during the storage. TaYo uses content-addressable storage (CAS) and Cuckoo hashing to generate a hash of the content that then serves as its identity. In TaYo, we have two I/O operations: read and write. To write data to TaYo, we split it into eight chunks, record the structure in a separate index and assign the chunks to worker processes that write concurrently. Each chunk is replicated twice. To read data, the client has to provide the identifier which the index uses to locate and re-assemble the chunks. TaYo uses a semi-active replication technique, a blend of active and passive replication while storing the data. It uses a consensus protocol built on top of Raft to guarantee consistency among the replicas.
Keywords: storage systems; storage engines; data management; peer-to-peer; immutable data; content-addressable storage; CAS.
International Journal of Cloud Computing, 2021 Vol.10 No.5/6, pp.655 - 668
Received: 09 Jan 2020
Accepted: 03 May 2020
Published online: 19 Jan 2022 *