Fanuc Corporation

Kaimeng Wang

Wenjie Chen

Hajime Suzuki

Tetsuaki Kato

Nobuaki Yamaoka

Shinichi Washizu

Shuusuke Watanabe

Kouichirou Hayashi

Satoshi Inagaki

Takahiro Iwatake

Bunketsu Chin

Ya Cho

A robot system includes: a feature point position detection unit configured to detect, at a constant cycle, a position of a feature point of an obstacle that moves or deforms within a motion range of a robot; a movement path calculation unit configured to calculate a movement path of the robot before a motion of the robot; a mapping function derivation unit configured to derive a mapping function based on a position of the feature point that is detected at a time interval; and a path adjustment unit configured to dynamically adjust the movement path of the robot using the derived mapping function.

Robot system

A method for teaching a robot to perform an operation based on human demonstration with images from a camera. The method includes a teaching phase where a 2D or 3D camera detects a human hand grasping and moving a workpiece, and images of the hand and workpiece are analyzed to determine a robot gripper pose and positions which equate to the pose and positions of the hand and corresponding pose and positions of the workpiece. Robot programming commands are then generated from the computed gripper pose and position relative to the workpiece pose and position. In a replay phase, the camera identifies workpiece pose and position, and the programming commands cause the robot to move the gripper to pick, move and place the workpiece as demonstrated. A teleoperation mode is also disclosed, where camera images of a human hand are used to control movement of the robot in real time.

Robot teaching by human demonstration

A method for dual hand detection in robot teaching from human demonstration. A camera image of the demonstrator's hands and workpieces is provided to a first neural network which determines the identity of the left and right hand of the human demonstrator from the image, and also provides cropped sub-images of the identified hands. The first neural network is trained using images in which the left and right hands are pre-identified. The cropped sub-images are then provided to a second neural network which detects the pose of both the left and right hand from the images, where the sub-image for the left hand is horizontally flipped before and after the hand pose detection if second neural network is trained with right hand images. The hand pose data is converted to robot gripper pose data and used for teaching a robot to perform an operation through human demonstration.

Dual hand detection in teaching from demonstration

A hand control apparatus including an extracting unit extracting a grip pattern of an object having a shape closest to that of the object acquired by a shape acquiring unit from a storage unit storing and associating shapes of plural types of objects and grip patterns, a position and posture calculating unit calculating a gripping position and posture of the hand in accordance with the extracted grip pattern, a hand driving unit causing the hand to grip the object based on the calculated gripping position and posture, a determining unit determining if a gripped state of the object is appropriate based on information acquired by at least one of the shape acquiring unit, a force sensor and a tactile sensor, and a gripped state correcting unit correcting at least one of the gripping position and the posture when it is determined that the gripped state of the object is inappropriate.

Hand control apparatus and hand control system

A robot movement teaching apparatus including a movement path extraction unit configured to process time-varying images of a first workpiece and fingers or arms of a human working on the first workpiece, and thereby extract a movement path of the fingers or arms of the human; a mapping generation unit configured to generate a transform function for transformation from the first workpiece to a second workpiece worked on by a robot, based on feature points of the first workpiece and feature points of the second workpiece; and a movement path generation unit configured to generate a movement path of the robot based on the movement path of the fingers or arms of the human extracted by the movement path extraction unit and based on the transform function generated by the mapping generation unit.

Robot movement teaching apparatus, robot system, and robot controller

A control device includes a learning control part in which a difference is calculated between a target position and an actual position of a portion detected based on a sensor, and an operation-speed change rate is increased or reduced several times within a maximum value of the operation-speed change rate set for increasing or reducing the operation speed of a robot mechanism unit and within allowance conditions of vibrations occurring at the portion to be controlled; meanwhile, learning is repeated to calculate an updated compensation amount based on the difference and a previous compensation amount previously calculated for suppressing vibrations at each operation-speed change rate, and a convergent compensation amount and a convergent operation-speed change rate are stored after convergence of the compensation amount and the operation-speed change rate.

Robot for controlling learning in view of operation in production line, and method of controlling the same

A robot system that performs desired processing on a processing target object using a processing tool. The robot system includes a robot having an arm tip that holds the processing tool, a position detector that detects a position of the arm tip, and a robot controller that controls an operation of the robot based on a position command and a position feedback detected by the position detector. The robot controller includes an adjustment operation creating unit that, during adjustment of operation parameters for controlling the operation of the robot, acquires an application and an operation area of the robot and automatically creates an adjustment operation corresponding to the acquired application and the operation area and a parameter adjustment unit that automatically adjusts the operation parameters during execution of the adjustment operation created by the adjustment operation creating unit so that a performance required for the application is satisfied.

Robot system for adjusting operation parameters

A device that can prevent a decrease in an efficiency of a manufacturing line. The device includes a shape acquisition section for acquiring a shape of a workpiece; a motion pattern acquisition section for acquiring basic motion patterns including a reference workpiece shape, a reference working position in the reference workpiece shape, and a type of an operation carried out on the reference working position; a similarity determination section for determining whether a shape of the workpiece is similar to the reference work piece shape; a position determination section for, based on a shape of the workpiece and the reference workpiece shape, determining the working position on the workpiece that corresponds to the reference working position; and an motion-path generation section for, by changing the reference working position to the determined working position, generating a motion path.

Device, system, and method for automatically generating motion path of robot

A robot system includes a light source, an image capture device, a robot mechanism unit having a target site of position control where the light source is provided, and a robot controller that controls the position of the robot mechanism unit based on a position command, a position feedback, and a position compensation value. The robot controller includes a path acquisition unit that makes the image capture device capture an image of light from the light source continuously during the predetermined operation to acquire a path of the light source from the image capture device, a positional error estimation unit that estimates positional error of the path of the light source from the position command based on the acquired path of the light source and the position command, and a compensation value generation unit that generates the position compensation value based on the estimated positional error.

A control device repeats learning of: calculating an allowable condition for speed variations during a processing operation based on an allowable condition for processing error; setting an operating speed change rate used to increase or reduce an operating speed of a robot mechanism unit using a calculated allowable condition for speed variations; and, while increasing or reducing the operating speed change rate over a plurality of repetitions within a range not exceeding a maximum value of the operating speed change rate and within a range of an allowable condition for vibrations occurring in a control target, calculates a new correction amount based on an amount of difference between a position of the control target detected based on a sensor and a target position, and a previously-calculated correction amount.

Robot that carries out learning control in applications requiring constant speeds, and control method thereof

A robot system is provide with a robot control device that includes an operation control unit and a learning control unit. The learning control unit performs a learning control in which a vibration correction amount for correcting a vibration generated at a control target portion of a robot is calculated and the vibration correction amount is employed in the operation command at a next time. The learning control unit includes a plurality of learning control parts for calculating the vibration correction amount and a selection unit that selects one of the plurality of learning control parts on the basis of operation information of the robot when the robot is made to be operated by an operation program that is a target of the learning control.

Robot system having learning control function and learning control method

Provided is a machine system including a machine including a movable part; a control device; a sensor detecting information about the movable part during a predetermined operation of the machine; a transmitting unit wirelessly transmitting the detected information during the predetermined operation; a receiving unit receiving the wirelessly transmitted information; a storage unit storing the received information; a detection unit detecting a loss in the received information; a command unit causing the machine to repeat the predetermined operation, in a case where a loss in the information is detected; a determination unit determining whether or not every lost part of the information detected first is contained in the information detected during the repeated operation; and an complementing unit ending the repeated operation in a case where every lost part is determined to be contained and complementing the information detected first with the information detected during the repeated operation.

Machine system

A robot controller having a function that simplifies learning and a robot control method. The robot controller includes: a learning section configured to carry out learning of detecting a deviation between a commanded trajectory representing a position of the robot generated according to the command values and an operation trajectory representing an actual position where the robot has moved, and generate a corrected program by adjusting the commanded trajectory; a saving section configured to save the corrected program; and a relearning section configured to carry out relearning on a relearning location, the relearning location being a part of the operation trajectory designated by an operator.

Robot controller having function that simplifies learning, and robot control method

A shape recognition device that recognizes a shape of an object having an indefinite shape and flexibility, and assembled by a robot, the shape recognition device including: an imaging unit that images the object; an image processing unit that recognizes the shape of the object on the basis of the object imaged by the imaging unit; and a simulation processing unit that simulates the shape of the object on the basis of the image of the object imaged by the imaging unit. The simulation processing unit interpolates a recognition result of the shape of the object by the image processing unit, on the basis of a simulation result of the shape of the object.

Shape recognition device, shape recognition method, and program

A robot control device includes a feature-point detecting unit that detects, from an image of an object acquired by a visual sensor, the positions of a plurality of feature points on the object in a predetermined cycle; a position/orientation calculating unit that updates, in the predetermined cycle, respective equations of motion of the plurality of feature points on the basis of the detected positions of the plurality of feature points and that calculates the position or orientation of the object on the basis of the detected positions of the plurality of feature points calculated from the updated equations of motion; and a robot-arm-movement control unit that controls the movement of a robot arm so as to follow the object, on the basis of the calculated position or orientation of the object.

Growing community of inventors

Yamanashi, Japan

Kaimeng Wang