Fanuc Corporation

Toshiyuki Ando

Kazunori Ban

Ichiro Kanno

Hidetoshi Kumiya

A learning dataset generation device includes: a memory that stores three-dimensional CAD data of a workpiece and a container; and one or more processors including hardware, wherein the one or more processors are configured to use the three-dimensional CAD data of the workpiece and the container, stored in the memory, to generate, in a three-dimensional virtual space, a plurality of imaging objects in which a plurality of the workpieces are bulk-loaded in different forms inside the container, acquire a plurality of virtual distance images by measuring each of the generated imaging objects by means of a virtual three-dimensional measurement machine disposed in the three-dimensional virtual space, accept at least one teaching position for each of the acquired virtual distance images, and generate a learning dataset by associating the accepted teaching position with each of the virtual distance images.

Learning dataset generation device and learning dataset generation method

A robot system including an articulated robot equipped with a tool attached to a distal-end wrist axis, a sensor that detects a position and an orientation of the workpiece, and a controller configured to control the robot based on an operation program. The operation program includes two or more teaching points, each of which defines a position and an orientation of the tool, and an operation instruction. The controller is configured to correct the position and the orientation of the tool at a first teaching point based on the detected position and the orientation, determine whether an angle of the distal-end wrist axis at the first teaching point after correction exceeds an operating limit, and when it is determined that the operating limit is exceeded, change the angle, at the first teaching point, to an angle to be within the operating range by increasing or decreasing the angle.

Robot system and control method

The purpose of the present invention is to provide a workpiece unloading device that can stabilize cycle time even when work for reversing a workpiece is involved. A workpiece unloading system comprises a workpiece unloading device for unloading a workpiece, and a control device for setting workpiece unloading order. The control device comprises: a storage unit that stores a set posture representing a posture of a workpiece when the workpiece is set on a jig; a current posture detection unit that detects a current posture representing the current posture of the workpiece; a change amount calculation unit that calculates a change amount between the set posture and the current posture; an unloading candidate identification unit that compares the change amount with a threshold value, and identifies, on the basis of the comparison result, a workpiece as an unloading candidate with priority; and an unload instruction unit that outputs, to the workpiece unloading device, a first instruction to unload the workpiece as the unloading candidate with priority.

Workpiece unloading device

A controller for controlling an operation of a machine or a robot for handling an object by includes: a sensor signal acquisition unit that acquires a signal from a sensor that outputs three-dimensional point cloud data and a corresponding camera image of an imaging subject; a region acquisition unit that acquires a region having a height lower than a predetermined value; a non-object region setting unit that sets, as a non-object region, a region of the camera image corresponding to the acquired region; a complementary color setting unit that sets a color of the non-object region to a color complementary to a color of the object; an object position recognition unit that recognizes a position of the object relative to the imaging subject from the camera image; and an operation control unit that controls the operation of the machine or the robot using at least the recognized position.

Controller, control method using controller, and control system

A workpiece pick up system including: a three-dimensional sensor which is placed at an upper side of a container and which obtains a group of three-dimensional points each of which has height position information in the container, a group creating means which creates a plurality of three-dimensional point groups in each of which adjacent points satisfy a predetermined condition, an exclusion group determining means which determines that one or more three-dimensional point groups which satisfy at least one of a predetermined size reference, a predetermined area reference, and a predetermined length reference are excluded groups, and a workpiece detecting means which obtains a group of detection-purpose three-dimensional points for detecting workpieces by excluding points included in the excluded group from the group of three-dimensional points or the plurality of three-dimensional point groups, and which detects the workpieces to be picked up by using the group of detection-purpose three-dimensional points.

Workpiece pick up system

A workpiece picking system including: a robot; a hand, attached to a hand tip portion of the robot, for picking workpieces; a three-dimensional sensor, attached to the hand tip portion, for acquiring positional information of a three-dimensional point group in a partial region in a container; a workpiece state calculation unit which calculates a position and posture of a workpiece based on positional information of a three-dimensional point group in an acquired first partial region; a data acquisition position calculation unit which calculates a robot corresponding to a second partial region where positional information is to be acquired next, based on the positional information of the three-dimensional point group in the acquired first partial region; and a control unit which controls the robot and the hand based on the calculated position and posture of the workpiece and based on the calculated robot position corresponding to the second partial region.

Workpiece picking system

A workpiece position/posture calculation system which is able to efficiently calculate a position and posture of a workpiece utilizing 3D matching. The workpiece position/posture calculation system includes a workpiece position/posture calculation part comparing measurement data including 3D position information of a workpiece obtained by a 3D measuring device against a 3D model of the workpiece to calculate the position and posture of the workpiece. Further, the workpiece position/posture calculation system further includes a measurement data excluding part excluding part of the measurement data to be used in subsequent calculation by the workpiece position/posture calculation part based on the calculated position and posture of the workpiece.

Workpiece position/posture calculation system and handling system

An image processing device according to the present invention includes container reference position and posture setting unit for setting a position and posture to be a reference for the container, workpiece reference height setting unit for setting a height to be a reference for the workpiece, a reference search window setting unit, container position and posture acquisition unit, a workpiece height calculation unit a search window calculation unit for calculating an amount of adjustment of the search window from the reference container position and posture, the workpiece reference height, the container position and posture, and the workpiece height, and calculating the search window from the reference search window and the amount of adjustment of the search window, and workpiece detection unit for detecting the workpiece from the image using the calculated search window.

Image processing device with function for automatically adjusting search window

An article pickup device configured so as to select a first and second three-dimensional points present in the vicinity of each other based on position information of the plurality of three-dimensional points acquired by a three-dimensional measurement instrument and image data acquired by a camera, acquire an image gradient information in a partial image region including points on an image corresponding to these three-dimensional points, judge whether the first and second three-dimensional points are present on the same article based on a position information of the three-dimensional points and the image gradient information, and add the first and second three-dimensional points to the same connected set when it is judged that the first and second three-dimensional points are present on the same article.

Apparatus and method for picking up article disposed in three-dimensional space using robot

An article take-out apparatus including, acquiring a reference container image including an open end face of a container by imaging operation by an camera, setting an image search region corresponding to a storage space of the container based on the reference container image, setting a reference plane including the open end face of the container, calculating a search region corresponding to the image search region based on a calibration data of the camera stored in advance, converting the search region to a converted search region, taking out 3D points included in the converted search region by projecting a plurality of 3D points measured by the 3D measuring device on the reference plane, and recognizing positions of articles inside the container using the 3D points.

Apparatus for taking out bulk stored articles by robot

A workpiece removing device including a camera for imaging a workpiece loading area including a plurality of workpieces loaded in bulk; a workpiece detection section for detecting a workpiece, based on a camera image taken with the camera; a workpiece selection section for selecting a workpiece adapted to be removed, based on a detection result by the workpiece detection section; a robot for removing the workpiece selected by the workpiece selection section; a loading state determination section for determining whether a loading state of the workpieces in the workpiece loading area has changed due to a operation of the robot; and an area setting section for setting a workpiece detection area where the workpiece detection section detects a workpiece. If the loading state determination section determines that the loading state of the workpieces has changed, the area setting section sets the workpiece detection area in a peripheral area of a changing position of the loading state, i.e., in a portion of the workpiece loading area.

Growing community of inventors

Yamanashi, Japan

Toshiyuki Ando