Title: Cloudpress 2.0: a new-age news retrieval system on the cloud

Authors: Arockia Anand Raj; T. Mala

Addresses: Department of Information Science and Technology, College of Engineering, Guindy Campus, Anna University, Chennai – 600025, Tamil Nadu, India ' Department of Information Science and Technology, College of Engineering, Guindy Campus, Anna University, Chennai – 600025, Tamil Nadu, India

Abstract: In this era of the internet, a huge amount of news articles are added every minute of everyday. As a result of this evergrowing amount of news articles, news retrieval systems are required to process the news articles frequently and intensively. The news retrieval systems that are in use today barely cope up with these data-intensive computations. Cloudpress 2.0 presented here, is designed and implemented to be scalable, robust and fault tolerant. It is designed in such a way that all the processes involved in news retrieval, such as fetching, text processing, image processing, indexing, storing and summarising, exploit MapReduce paradigm and use the power of the cloud computing. It uses novel approaches for parallel processing, for storing the news articles in a distributed database and for visualising them as a 3D visual. It uses Lucene-based indexing for efficient and faster retrieval. It also includes a novel query expansion feature for searching the news articles. Cloudpress 2.0 also allows on-the-fly, extractive summarisation of news articles based on the input query.

Keywords: distributed databases; information visualisation; 3D visualisation; parallel processing; retrieval models; MapReduce; news retrieval; cloud computing; fault tolerance; query expansion; article searching; news articles; news article summaries; information retrieval; text processing; image processing.

DOI: 10.1504/IJICT.2013.053114

International Journal of Information and Communication Technology, 2013 Vol.5 No.2, pp.150 - 166

Received: 01 May 2012
Accepted: 11 Sep 2012

Published online: 19 Dec 2013 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article