Mujin, Inc.

Rosen Nikolaev Diankov

Xutao Ye

Denys Kanunikov

Russell Islam

Yoshiki Kanemoto

Jinze Yu

Jose Jeronimo Moreira Rodrigues

Huan Liu

Hironori Mizoguchi

Puttichai Lertkultanon

Isamu Arase

Satoshi Tendo

Ziyan Zhou

Shintaro Matsuoka

Ahmed Abouelela

Shekhar Gupta

Lei Lei

Kei Usui

Shunichi Nozawa

Yixuan Zhang

Hamdi Sahloul

Aditi Pandya

Xu Chen

Yi Xu

Yufan Du

Xuming Zheng

Pai Zheng

Brandon Coats

A system and method for operating a transfer robot to grasp and transfer objects is disclosed. The transport robot includes a robotic gripper assembly having an array of addressable vacuum regions each configured to independently provide a vacuum to grasp a target object. The gripper assembly can be configured and/or operated according to one or more physical characteristics of targeted objects and/or corresponding scenarios.

Robotic gripper assemblies for openable object(s) and methods for picking objects

A robot control system and a method for automatic camera calibration is presented. The robot control system includes a control circuit configured to determine all corner locations of an imaginary cube that fits within a camera field of view, and determine a plurality of locations that are distributed on or throughout the imaginary cube. The control circuit is further configured to control a robot arm to move a calibration pattern to the plurality of locations, and to receive a plurality of calibration images corresponding to the plurality of locations, and to determine respective estimates of intrinsic camera parameters based on the plurality of calibration images, and to determine an estimate of a transformation function that describes a relationship between a camera coordinate system and a world coordinate system. The control circuit is further configured to control placement of the robot arm based on the estimate of the transformation function.

Method and system for performing automatic camera calibration for robot control

A method performed by a computing system is presented. The method may include the computing system receiving image information that represents an object surface associated with a flexible object, and identifying, as a grip region, a surface region of the object surface that satisfies a defined smoothness condition and has a region size that is larger than or equal to a defined region size threshold, wherein the grip region is identified based on the image information. The method may further include identifying, as a safety region, a three-dimensional (3D) region which surrounds the grip region in one or more horizontal dimensions, and which extends from the grip region along a vertical dimension that is perpendicular to the one or more horizontal dimensions. The method may further include performing robot motion planning based on the grip region and the safety region.

Method and computing system for performing grip region detection

An object gripping assembly and associated systems and methods are disclosed herein. In some embodiments, the object gripping assembly includes a first carrying plate with a first mounting track extending along a first axis and two or more second carrying plates movably carried by the first mounting track. Each of the two or more second carrying plates can include a second mounting track extending along a second axis at least and extendable gripping components movably carried by the second mounting track. A first pitch adjusting component can be operably coupled the two or more second carrying plates to controllably change the pitch of the two or more second carrying plates along the first mounting track. A second pitch adjusting component can be operably coupled to the extendable gripping components on a corresponding second carrying plate to controllably change the pitch of the extendable gripping components along the second mounting track.

Robotic system with gripping mechanism

A computing system including a processing circuit in communication with a robot and a camera having a field of view. The processing circuit obtains image information based on the objects in the field of view and a loading environment, the loading environment which includes loading areas, an object queue, and a buffer zone. The computing system is configured to use the obtained image information in motion planning operations for the retrieval and placement of objects from the object queue into the loading environment. Pallets provided within the loading environment (i.e., within the loading areas) are dedicated to receiving objects having corresponding object type identifiers. The computer system further uses the image information to determine the fill status of pallets existing within the loading environment, and whether new pallets need to be brought into the loading environment and/or swapped out with existing pallets to account for future planning and placement operations.

System and method for robotic object placement

A controller for a robotic system is provided. The controller may derive first data including information about operation objects and information about pallet before loading and/or unloading of the operation object on/from the pallet. The controller may derive a control sequence for loading and/or unloading the operation object on/from the pallet based on the first data before execution of the corresponding loading/unloading task. Based on the control sequence, the controller may instruct a robot to execute the task of loading and/or unloading the operation object on/from the pallet.

Controller and control method for robotic system

A system and method for operating a robotic system to register unrecognized objects is disclosed. The robotic system may use first image data representative of an unrecognized object to derive an initial minimum viable region (MVR). The robotic system may analyze second image data representative of the unrecognized object to detect a condition representative of an accuracy of the initial MVR. The robotic system may register the initial MVR or an adjustment thereof based on the detected condition.

Robotic system with automated object detection mechanism and methods of operating the same

A robotic system for arranging packages at a destination according to a stacking sequence. The robotic system uses a storage area for temporarily storing packages that arrive out-of-sequence until they are next-in-sequence for placement at the destination. The robotic system processes an incoming package, determines if it is next-in-sequence for placement at the destination, and if it is, places the package at the destination. On the other hand, if it is not next-in-sequence for placement at the destination, it stores the package in the storage area. A package in the storage area is transferred to the destination when it is next-in-sequence for placement at the destination. By using the temporary storage for storing out of sequence packages, the robotic system eliminates the need for receiving the packages in a stacking sequence, which also eliminates the need for sequencing machines.

Robotic system for processing packages arriving out of sequence

A method for operating a transport robot includes receiving image data representative of a group of objects. One or more target objects are identified in the group based on the received image data. Addressable vacuum regions are selected based on the identified one or more target objects. The transport robot is command to cause the selected addressable vacuum regions to hold and transport the identified one or more target objects. The transport robot includes a multi-gripper assembly having an array of addressable vacuum regions each configured to independently provide a vacuum. A vision sensor device can capture the image data, which is representative of the target objects adjacent to or held by the multi-gripper assembly.

Robotic multi-gripper assemblies and methods for gripping and holding objects

A system and method for estimating aspects of target objects and/or associated task implementations is disclosed.

Robotic system with image-based sizing mechanism and methods for operating the same

A system and method for operating a robotic system to use two or more tools to manipulate objects. The robotic system may coordinate planning processes and/or plan implementations based on grouping the objects.

Robotic tools and methods for operating the same

A control apparatus includes a first information acquiring section that acquires three-dimensional information of a first region of surfaces of a plurality of objects, the information being obtained by imaging or scanning the plurality of objects from a first location; a second information acquiring section that acquires three-dimensional information of a second region of surfaces of the plurality of objects, the information being obtained by imaging or scanning the plurality of objects from a second location; and a combining section that generates information indicating three-dimensional shapes of at least a portion of the surfaces of the plurality of objects, based on the three-dimensional information of the first region acquired by the first information acquiring section and the three-dimensional information of the second region acquired by the second information acquiring section.

Shape information generation apparatus, control apparatus, loading/unloading apparatus, logistics system, non-transitory computer-readable medium, and control method

A multi-purpose labeling system can include a conveyor, a visual analysis module, and a labeling assembly. The conveyor can move an object in a first direction. The visual analysis module can include an optical sensor directed toward the conveyor to generate image data depicting the object. The labeling assembly can be spaced from the conveyor in a second direction and include a printer, a labeling module, and an alignment assembly. The printer can print a label based on the image data, and the labeling module can have a labeling plate for receiving the label. The alignment assembly can include a lateral-motion module, a vertical-motion module, and a rotary module for moving the labeling module along or about the first, the second, and a third direction, and can place the labeling plate adjacent to an object surface.

Robotic systems with multi-purpose labeling systems and methods

A method and computing system for transferring objects between a source repository and a destination repository is provided. The computing system is configured to operate by a combination of pre-planned and image base trajectories to improve speed and reliability of object transfer. The computing system is configured to capture image information of repositories and use the captured information to alter or adjust pre-planned trajectories to improve performance.

Method and computing system for performing robot motion planning and repository detection

An trajectory information generating unit for generating trajectory information defining a trajectory for which a picking hand picks a work at a first position and arranges the work at a second position, an execution control unit for operating a picking apparatus based on trajectory information generated by the trajectory information generating unit, and an execution time estimating unit for estimating a period of time from when the picking apparatus receives an instruction for starting an operation on a work to a time when the operation of the picking apparatus on the work is ended are included. The trajectory information generating unit may adjust an amount of calculation based on an estimation result of the execution time estimating unit.

Growing community of inventors

Tokyo, Japan

Rosen Nikolaev Diankov