Title: Data aggregation to better understand the impact of computerisation on employment
Authors: James Otto; Chaodong Han
Addresses: Department of E-Business and Technology Management, Towson University, 8000 York Road, Towson, MD 21252, USA ' Department of E-Business and Technology Management, Towson University, 8000 York Road, Towson, MD 21252, USA
Abstract: Data reduction methods are called for to address challenges presented by big data. Correlation of two variables may be less clear if data are organised at disaggregate levels in regression analysis. In this study, we apply data aggregation to regression analysis in the context of a study forecasting the impact of computerisation on jobs and wages. We show that data grouped by the ranked independent variable, versus random or other grouping schemes, provides a clearer pattern of the employment impacts of computerisation probability on job categories. The coefficient estimates are more consistent for groupings based on a ranked independent variable, than those provided by random grouping of the same independent variable. The improved estimations can have positive policy implications.
Keywords: data reduction methods; impact of computerisation; automation; computerisation probability; data grouping schemes; statistical regression; data aggregation; ranked regression; information reduction.
DOI: 10.1504/IJDATS.2020.111479
International Journal of Data Analysis Techniques and Strategies, 2020 Vol.12 No.4, pp.299 - 317
Received: 15 Jan 2018
Accepted: 04 Feb 2019
Published online: 30 Nov 2020 *