Query optimisation in real-time data warehouses Online publication date: Fri, 17-Jan-2020
by Issam Hamdi; Emna Bouazizi; Jamel Feki
International Journal of Intelligent Information and Database Systems (IJIIDS), Vol. 12, No. 4, 2019
Abstract: A real-time data warehouse (RTDW) allows decision makers to analyse fresh data as fast as possible in order to support real-time decision processes. In this paper, we focus on optimisation techniques to speed up query processing; in particular, we propose a dynamic selection of materialised views algorithm (DynaSeV) which selects views from results of incoming queries. Secondly, we suggest a new update policy to dynamically maintain materialised views. In addition, we propose a novel data partitioning approach for RTDW, called 2LPA-RTDW (Two-Level data Partitioning Approach for RTDW) by allowing unbalance of data amount in each partition. Then, we present our architecture called DETL-(m, k)-firm-RTDW architecture (decentralised extract-transform-load approach based on (m, k)-Firm constraints for RTDW) which deals with diversity and disparities in data source systems to reduce the time for ETL. Finally, we evaluate our contributions using the TPC-DS (TPC, 2014) benchmark; the preliminary results are quite promising.
Online publication date: Fri, 17-Jan-2020
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Intelligent Information and Database Systems (IJIIDS):
Login with your Inderscience username and password:
Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.
If you still need assistance, please email firstname.lastname@example.org