Title: Big data visual exploration as a recommendation problem

Authors: Moustafa Sadek Kahil; Abdelkrim Bouramoul; Makhlouf Derdour

Addresses: LAMIS Laboratory, Larbi Tebessi University, Tébessa, Algeria ' MISC Laboratory, NTIC Faculty, Constantine 2 University, Constantine, Algeria ' LRS Laboratory, Larbi Ben M'hidi University, Oum El Bouaghi, Algeria

Abstract: Big data visual exploration is believed to be considered as a recommendation problem. This proximity concerns essentially their purpose: it consists in selecting among huge amount of data those that are the most valuable according to specific criteria, to eventually present it to users. On the other hand, the recommendation systems are recently resolved mostly using neural networks (NNs). The present paper proposes three alternative solutions to improve the big data visual exploration based on recommendation using matrix factorisation (MF) namely: conventional, alternating least squares (ALS)-based and NN-based methods. It concerns generating the implicit data used to build recommendations, and providing the most valuable data patterns according to the user profiles. The first two solutions are developed using Apache Spark, while the third one was developed using TensorFlow2. A comparison based on results is done to show the most efficient one. The results show their applicability and effectiveness.

Keywords: big data visualisation; recommendation systems; collaborative filtering; content-based filtering; matrix factorisation; alternating least square; machine learning; neural networks.

DOI: 10.1504/IJDMMM.2023.131378

International Journal of Data Mining, Modelling and Management, 2023 Vol.15 No.2, pp.133 - 153

Received: 17 Mar 2021
Accepted: 08 Apr 2022
Published online: 09 Jun 2023 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article