Title: Analysing the characteristics of crowdsourcing platforms for improving throughput

Authors: Ayswarya R. Kurup; G.P. Sajeev

Addresses: Department of Computer Science and Engineering, Amrita School of Engineering, Amrita Vishwa Vidyapeetham, Amritapuri, India ' Department of Computer Science and Engineering, Amrita School of Engineering, Amrita Vishwa Vidyapeetham, Amritapuri, India

Abstract: Crowdsourcing leverages human intelligence to gather solutions on tasks that cannot be accomplished by automated tools. This system consists of components such as the requester, task, worker and the crowdsourcing platform. Studies do not explore the various features of these components and the dependencies among the same. Hence, we analyse the characteristics of the components of crowdsourcing systems using a trace-driven approach. Additionally, for reproducible research, we have introduced a workload generator for crowdsourcing platforms, which generates an unbiased workload similar to the empirical workload. Finally, the impact of various characteristics on the quality of answers has been analysed using both the empirical and synthetic workloads. The results demonstrate that success rate and activeness positively affect the productivity of workers, while the number of available human intelligence tasks (HITs) and the time duration of the same affect the productivity on each task.

Keywords: crowdsourcing; behavioural analysis; probability distribution; workload generation.

DOI: 10.1504/IJWET.2019.105588

International Journal of Web Engineering and Technology, 2019 Vol.14 No.3, pp.255 - 279

Published online: 05 Mar 2020 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article