Title: Vision-based approach for the localisation and manipulation of ground-based crop

Authors: Bourhane Kadmiry; Chee Kit Wong; Patrick P.K. Lim

Addresses: Intelligent Machines and Devices Group, Callaghan Innovation, 24 Balfour Road, Auckland 1052, New Zealand ' Intelligent Machines and Devices Group, Callaghan Innovation, 24 Balfour Road, Auckland 1052, New Zealand ' Intelligent Machines and Devices Group, Callaghan Innovation, 24 Balfour Road, Auckland 1052, New Zealand

Abstract: This article describes an approach to autonomous robotic farming based on vision and manipulation. The coherent technological setup is aiming at rendering intelligent crop manipulation based on crop localisation. The scientific contribution is focused on an approach that analyses point cloud information from a time-of-flight (ToF) camera to identify the location of foremost spring onions along the crop bed, for the intention of robotic manipulation. The process uses a combination of 2D image processing on the amplitude data, as well as depth analysis on the point cloud information, extracted from the camera to locate the desired object. Whilst the experimental results demonstrated the robustness of this approach, further testing is required to determine the ability of system to cope with different scenarios that exists in the naturally varying environment. Finally, the accuracy of the system has been validated in the physical world, to a certain extent, by integrating the localisation algorithm to the robotic manipulation system.

Keywords: autonomous robots; farm robotics; point cloud data; 3D object localisation; compliant manipulation; ToF camera; robot vision; intelligent crop manipulation; ground-based crops; crop localisation; spring onions; robotic manipulation; image processing.

DOI: 10.1504/IJCAT.2014.063909

International Journal of Computer Applications in Technology, 2014 Vol.50 No.1/2, pp.61 - 74

Published online: 08 Apr 2015 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article