Mujin, Inc.

Yoshiki Kanemoto

Rosen Nikolaev Diankov

Jinze Yu

Jose Jeronimo Moreira Rodrigues

Xutao Ye

Russell Islam

Huan Liu

Denys Kanunikov

Hironori Mizoguchi

Ahmed Abouelela

Shintaro Matsuoka

Puttichai Lertkultanon

A system and method for operating a transfer robot to grasp and transfer objects is disclosed. The transport robot includes a robotic gripper assembly having an array of addressable vacuum regions each configured to independently provide a vacuum to grasp a target object. The gripper assembly can be configured and/or operated according to one or more physical characteristics of targeted objects and/or corresponding scenarios.

Robotic gripper assemblies for openable object(s) and methods for picking objects

A method performed by a computing system is presented. The method may include the computing system receiving image information that represents an object surface associated with a flexible object, and identifying, as a grip region, a surface region of the object surface that satisfies a defined smoothness condition and has a region size that is larger than or equal to a defined region size threshold, wherein the grip region is identified based on the image information. The method may further include identifying, as a safety region, a three-dimensional (3D) region which surrounds the grip region in one or more horizontal dimensions, and which extends from the grip region along a vertical dimension that is perpendicular to the one or more horizontal dimensions. The method may further include performing robot motion planning based on the grip region and the safety region.

Method and computing system for performing grip region detection

A control apparatus includes a force sensation information acquiring unit for acquiring force sensation information representing a magnitude of at least one of a force and a torque at a distal end of a manipulator while a target item is being transported; a mass information acquiring unit for acquiring mass information representing a mass of the item; a plan information acquiring unit for acquiring plan information representing content of a plan of a trajectory; a force sensation estimating unit for estimating a magnitude of at least one of a force and a torque to be detected at the distal end of the manipulator; and a first detecting unit for detecting an abnormality, based on the magnitude of at least one of the force and the torque represented by the force sensation information and the magnitude of at least one of the force and the torque estimated by the estimating unit.

Methods and systems for detecting transport abnormality

End effectors for use with a robotic object-gripping system, and related systems and methods, are disclosed herein. In some embodiments, the end effector includes a first mounting structure, a force sensor coupled to the first mounting structure, a second mounting structure coupled to the force sensor, and a gripper assembly coupled to the second mounting structure. The force sensor is beneath the longitudinal plane and is configured to measure forces along a vertical axis. The end effector also includes a first bracket coupled to the first mounting structure and a second bracket coupled to the second mounting structure. The first and second brackets are configured to connect to the connection tubes to isolate the connection tubes, and any forces therein, to a longitudinal direction between the first bracket and the second bracket, thereby reducing the noise on the force sensor from the connection tubes during operation.

Robotic systems with mass detection, and related systems and methods

A system and method for determining a misdetection of an object and subsequent response is disclosed. A robotic system may use a motion plan, which is derived based on an initial detection result of a package, to transfer the package from a start location to a task location. During implementation of the motion plan, the robotic system may obtain additional sensor data, which can be used to deviate from the initial motion plan and implement a replacement motion plan to transfer the package to the task location.

Robotic system with object update mechanism and methods for operating the same

The present disclosure provides a control method of a robotic system. The control method includes: deriving an approach location at which the end effector grips an operation object; deriving a scan location for scanning an identifier of the operation object; and based on the approach location and the scan location, creating or deriving a control sequence to instruct the robot to execute the control sequence. The control sequence includes (1) gripping the operation object from a start location; (2) scanning an identifier of the operation object with a scanner located between the start location and a task location; (3) temporarily releasing the operation object from the end effector and regripping the operation object by the end effector to be shifted, at a shift location, when a predetermined condition is satisfied; and (4) moving the operation object to the task location.

Robotic system control method and controller

A computing system including a processing circuit in communication with a camera having a field of view. The processing circuit obtains image information based on the objects in the field of view and defines a minimum viable region for a target open corner. Potential minimum viable regions are defined by identifying candidate edges of an object and determining potential intersection points based on the candidate edges. The minimum viable region may then be identified and validated from the potential minimum viable regions.

Robotic system for object size detection

A system and method for operating a robotic system to scan and register unrecognized objects is disclosed. The robotic system may use an image data representative of an unrecognized object located at a start location to implement operations for transferring the unrecognized object from the start location. While implementing the operations, the robotic system may obtain additional data, including scanning results of one or more portions of the unrecognized object not included in the image data. The robotic system may use the additional data to register the unrecognized object.

Robotic system with automated package scan and registration mechanism and methods of operating the same

A method and computing system for performing the method are presented. The method may include receiving image information representing an object; identifying a set of one or more matching object recognition templates associated with a set of one or more detection hypotheses. The method may further include selecting a primary detection hypothesis associated with a matching object recognition template; generating a primary candidate region based on the matching object recognition template; determining at least one of: (i) whether the set of one or more matching object recognition templates has a subset of one or more remaining matching templates, or (ii) whether the image information has a portion representing an unmatched region; and generating a safety volume list based on at least one of: (i) the unmatched region, or (ii) one or more additional candidate regions that are generated based on the subset of one or more remaining matching templates.

Method and computing system for generating a safety volume list for object detection

A method of operating a robotic system includes: receiving first image data representative of a package surface; identifying a pair of edges based on the first image data; determining a minimum viable region based on the pair of edges; receiving second image data representative of the package after the lift; and creating registration data based on the first and second image data.

Automated package registration systems, devices, and methods

The present disclosure relates to operation of a robotic system to transfer an object from a source to a destination. The robotic system may implement one or more motion plans or portions thereof to operate a picking robot to grip and lift the object and place a transfer tray under the lifted object. The robotic system may further implement the one or more motion plans or portions thereof to place the object on the transfer tray and laterally displace the transfer tray and the object thereon toward the destination. The robotic system may operate a placement mechanism to transfer the object from the transfer tray to the destination.

Robotic system with a coordinated transfer mechanism

A control method includes: deriving an approach location at which the end effector grips an operation object; deriving a scan location for scanning an identifier of the operation object; and based on the approach location and the scan location, creating or deriving a control sequence to instruct the robot to execute the control sequence. The control sequence includes (1) gripping the operation object from a start location; (2) scanning an identifier of the operation object with a scanner located between the start location and a task location; (3) temporarily releasing the operation object from the end effector and regripping the operation object by the end effector to be shifted, at a shift location, when a predetermined condition is satisfied; and (4) moving the operation object to the task location.

Growing community of inventors

Tokyo, Japan

Yoshiki Kanemoto