Title: Warehousing and analysing textual data

Authors: Sarah Attaf; Nadjia Benblidia; Omar Boussaid

Addresses: Faculty of Sciences LRDSI Laboratory, Department of Computer Science, University of Blida 1, route de Soumâa BP 270, Blida, 09000, Algeria ' Faculty of Sciences LRDSI Laboratory, Department of Computer Science, University of Blida 1, route de Soumâa BP 270, Blida, 09000, Algeria ' ERIC Laboratory, Department of Computer Science, University of Lyon 2, 5 AV. P. Mends-France 69676 Bron Cedex, Lyon, France

Abstract: Traditional data warehousing technologies have been widely used for simple data analysis. Nonetheless, they are not suitable for textual data. To deal with this type of complex data, new systems have been proposed. However, they only cover partially the complexity of textual data, which might therefore affect decision-making quality. This paper proposes an efficient approach for warehousing and analysing textual data. To tackle the main challenges facing these data, three major contributions are presented throughout our manuscript: i) a Semantic Text Cube Model (ST-Cube); ii) a new ETL approach (Extract Transform and Load); iii) an OLAP aggregation operator called Top_KRankedTopics. For the validation of our approach, we have developed and implemented a platform for the storage and the analysis of text documents. Experimental results show that our approach improves significantly the quality of information extracted from textual documents, which prove the effectiveness of our approach for textual data analysis.

Keywords: data warehousing; textual data analysis; semantic text cube; ETL approach; online analytical processing (OLAP) operators; Top_KRankedTopics; semantic factors.

DOI: 10.1504/IJMMNO.2018.088972

International Journal of Mathematical Modelling and Numerical Optimisation, 2018 Vol.8 No.3, pp.216 - 244

Available online: 26 Dec 2017 *

Full-text access for editors Access for subscribers Purchase this article Comment on this article