Title: Peer-to-peer storage engine for schemaless immutable data

Authors: José Ghislain Quenum; Alexander Brown Shipena

Addresses: Namibia University of Science and Technology, Windhoek, Namibia ' Motor Vehicle Accident Fund, Windhoek, Namibia

Abstract: We present TaYo, a peer-to-peer storage engine explicitly designed for immutable data which bypasses the file system during the storage. TaYo uses content-addressable storage (CAS) and Cuckoo hashing to generate a hash of the content that then serves as its identity. In TaYo, we have two I/O operations: read and write. To write data to TaYo, we split it into eight chunks, record the structure in a separate index and assign the chunks to worker processes that write concurrently. Each chunk is replicated twice. To read data, the client has to provide the identifier which the index uses to locate and re-assemble the chunks. TaYo uses a semi-active replication technique, a blend of active and passive replication while storing the data. It uses a consensus protocol built on top of Raft to guarantee consistency among the replicas.

Keywords: storage systems; storage engines; data management; peer-to-peer; immutable data; content-addressable storage; CAS.

DOI: 10.1504/IJCC.2021.120401

International Journal of Cloud Computing, 2021 Vol.10 No.5/6, pp.655 - 668

Received: 09 Jan 2020
Accepted: 03 May 2020
Published online: 19 Jan 2022 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article