Title: Capture, digitisation and segmentation of human-workpiece interactions in a manual assembly operation using Kinect™

Authors: Vinayak A. Prabhu; Ashutosh Tiwari; Windo Hutabarat; Christopher Turner

Addresses: Cranfield University, Cranfield, Bedfordshire, MK43 0AL, UK; Nanyang Polytechnic, 180 Ang Mo Kio Ave 8, 569830, Singapore ' Cranfield University, Cranfield, Bedfordshire, MK43 0AL, UK ' Cranfield University, Cranfield, Bedfordshire, MK43 0AL, UK ' Cranfield University, Cranfield, Bedfordshire, MK43 0AL, UK

Abstract: The modern manufacturing industry, especially in developed economies, is pushing towards automation of skill-intensive manual manufacturing operations to remain globally competitive. However, automation of such operations is not trivial because it is difficult to replace a highly skilled human with an equivalent machine. Therefore, it is necessary to capture and extract human skills from skill-intensive manufacturing operations in order to enable the process of automating such operations. To achieve this goal, the first step is to capture, digitise and segment the human-workpiece interactions during a simplified manual manufacturing operation in preparation for skill extraction. This paper presents one such attempt using a gaming interface device (Microsoft Kinect™) to simultaneously capture human actions and the resulting workpiece motions non-obtrusively in three dimensions in real-time. The captured human-workpiece interaction data is automatically segmented into human action states, represented as therbligs and workpiece states, using which the subsequent skill extraction can be performed. The use of therbligs also enables this work to be used for human motion analysis for effective and ergonomic design of assembly workstations.

Keywords: skills capture; digitisation; segmentation; human-workpiece interaction; skill-intensive manufacturing; Kinect; RGB-D; imaging; manual assembly; manufacturing skills; gaming interface; human actions; workpiece motions; ergonomic design; assembly workstations; workstation design; ergonomics; therbligs.

DOI: 10.1504/IJDE.2015.073855

International Journal of Design Engineering, 2015 Vol.6 No.1, pp.61 - 85

Accepted: 05 Sep 2015
Published online: 24 Dec 2015 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article