Title: An effective preprocessing algorithm for model building in collaborative filtering-based recommender system

Authors: T. Srikanth; M. Shashi

Addresses: Department of Computer Science and Engineering, College of Engineering, JNTU Kakinada, Kakinada, Andhra Pradesh, India ' Department of Computer Science and Systems Engineering, College of Engineering, Andhra University, Visakhapatnam, Andhra Pradesh, India

Abstract: Recommender systems suggest interesting items for online users based on the ratings expressed by them for the other items maintained globally as the rating matrix. The rating matrix is often sparse and very huge due to large number of users expressing their ratings only for a few items among the large number of alternatives. Sparsity and scalability are the challenging issues to achieve accurate predictions in recommender systems. This paper focuses on model building approach to collaborative filtering-based recommender systems using low rank matrix approximation algorithms for achieving scalability and accuracy while dealing with sparse rating matrices. A novel preprocessing methodology is proposed to counter data sparsity problem by transforming the sparse rating matrix denser before extracting latent factors to appropriately characterise the users and items in low dimensional space. The quality of predictions made either directly or indirectly through user clustering were investigated and found to be competitive with the existing collaborative filtering methods in terms of reduced MAE and increased NDCG values on bench mark datasets.

Keywords: recommender system; collaborative filtering; dimensionality reduction; pre-processing; sparsity; scalability; low rank approximation.

DOI: 10.1504/IJBIDM.2019.099964

International Journal of Business Intelligence and Data Mining, 2019 Vol.14 No.4, pp.489 - 503

Received: 21 Mar 2017
Accepted: 17 Jun 2017

Published online: 03 Jun 2019 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article