Title: A five-layer architecture for big data processing and analytics

Authors: Julie Yixuan Zhu; Bo Tang; Victor O.K. Li

Addresses: Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong ' Department of Computer Science and Engineering, Southern University of Science and Technology, 1088 Xueyuan Ave, Nanshan Qu, Shenzhen Shi, Guangdong Sheng, China ' Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong

Abstract: Big data technologies have attracted much attention in recent years. The academia and industry have reached a consensus, that is, the ultimate goal of big data is about transforming 'big data' to 'real value'. In this article, we discuss how to achieve this goal and propose five-layer architecture for big data processing and analytics (BDPA), including a collection layer, a storage layer, a processing layer, an analytics layer, and an application layer. The five-layer architecture targets to set up a de facto standard for current BDPA solutions, to collect, manage, process, and analyse the vast volume of both static data and online data streams, and make valuable decisions for all types of industries. Functionalities and challenges of the five-layers are illustrated, with the most recent technologies and solutions discussed accordingly. We conclude with the requirements for the future BDPA solutions, which may serve as a foundation for the future big data ecosystem.

Keywords: big data processing and analytics; BDPA; online big data stream; five-layer architecture.

DOI: 10.1504/IJBDI.2019.097399

International Journal of Big Data Intelligence, 2019 Vol.6 No.1, pp.38 - 49

Received: 11 Jan 2017
Accepted: 05 Feb 2018
Published online: 21 Jan 2019 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article