Title: Supporting the ETL-process by Web Service technologies

Authors: Lutz Schlesinger, Florian Irmert, Wolfgang Lehner

Addresses: Department of Database Systems, University of Erlangen-Nuremberg, 3 Martens str., 91058 Erlangen, Germany. ' Department of Database Systems, University of Erlangen-Nuremberg, 3 Martens str., 91058 Erlangen, Germany. ' Database Technology Group, Dresden University of Technology, 26 Durerstr., 01062 Dresden, Germany

Abstract: Extracting data from heterogeneous data sources and transferring data into the data warehouse system is one of the most cost intensive tasks in setting up and operating a data warehouse. Special tools may be used to connect different sources and target systems. In this paper, we propose an architecture which enables the flexible integration of data sources into any target database system. The approach is based on the idea of splitting the classical wrapping module into a source specific and a target specific part and establishing the communication between these components based on Web Service technology. We describe the general architecture, the use of Web Service technology to describe and dynamically integrate participating data sources and the deployment within a specific database system.

Keywords: data warehouse systems; ETL process; web service architecture; web services; database wrapper; data sources integration; relational database; extraction; transformation; loading.

DOI: 10.1504/IJWGS.2005.007547

International Journal of Web and Grid Services, 2005 Vol.1 No.1, pp.31 - 47

Published online: 03 Aug 2005 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article