Human-robot guiding system for agricultural objects detection in unstructured and noisy environment by integrated laser and vision

Abstract

A human-robot system and method for performing an agricultural task, the system including: a robotic manipulator with an agricultural tool coupled to an end effector thereof; an imaging device adapted to capture imagery of a target, the imaging device mechanically coupled to the end effector; a laser distance sensor adapted to measure a distance between the manipulator and the target, the laser distance sensor mechanically coupled to the end effector and collocated with the imaging device; and a control unit including: a processing unit, a monitor and a human-machine interface (HMI), wherein the processing unit is configured to display the imagery on the monitor and to receive markings from the HMI and calculate a trajectory for the manipulator to perform the agricultural task with the tool.