Dexterity, Inc.

Talbot Morris-Downing

Harry Zhe Su

Samir Menon

Kevin Jose Chavez

Zhouwen Sun

Rohit Arka Pidaparthi

Ayush Sharma

Raphael Georg Wirth

Yuan Gao

David Leo Tondreau, Iii

Toby Leonard Baker

Cyril Nader

Robert Holmberg

Timothy Andrew Ryan

Ben Varkey Benjamin Pottayil

Alberto Leyva Arvayo

Farshid Farhat

Rohun Kulkarni

Ivan Alberto Trujillo Priego

Robert Hegdahl

Cuthbert Sun

Michael Fisher

Timothy Ryan

Darshan Hegde

Ben Varkey Pottayil

Kevin Chavez

Rohit Pidaparthi

A kitting system is disclosed. In various embodiments, the kitting system includes a conveyance structure configured to impart to an item a first net resultant force substantially in a first direction, wherein the first direction is associated with a direction of flow from a source end of the conveyance structure to a destination end opposite the source end and associated with a pick-up zone from which the item is to be retrieved; a sensor configured to provide a sensor output associated with the pick-up zone; and a processor configured to provide a control input to one or both of the conveyance structure and a disrupter device associated with the conveyance structure based at least in part on the sensor output.

Robotic kitting system

A robotic singulation system is disclosed. In various embodiments, sensor data including data associated with an item present in a workspace is received. The sensor data is used to determine and implement a plan to autonomously operate a robotic structure to move and place the item singly in a corresponding location in a singulation conveyance structure. The plan takes into consideration an attribute of the item determined based at least in part on the sensor data.

Adaptive robotic singulation system

A set of one or more potentially graspable features for one or more objects present in a workspace area are determined based on visual data received from a plurality of cameras. For each of at least a subset of the one or more potentially graspable features one or more corresponding grasp strategies are determined to grasp the feature with a robotic arm and end effector. A score associated with a probability of a successful grasp of a corresponding feature is determined with respect to each of a least a subset of said grasp strategies. A first feature of the one or more potentially graspable features is selected to be grasped using a selected grasp strategy based at least in part on a corresponding score associated with the selected grasp strategy with respect to the first feature. The robotic arm and the end effector are controlled to attempt to grasp the first feature using the selected grasp strategy.

Autonomous unknown object pick and place

A robotic system comprising an end effector-mounted sensor is disclosed. In various embodiments, a robotic arm is manipulated to move a sensor to a position such that an object of interest is within a read range of the sensor. A sensor data read by the sensor is received via a communication interface. The sensor data is used to determine an attribute of the object; and the determined attribute of the object is used to determine a plan to grasp and move the object.

Robotic singulation system sensor

A robotic kitting machine is disclosed. In various embodiments, a robotic arm is used to move an item to a location in proximity to a slot into which the item is to be inserted. Force information generated by a force sensor is received via a communication interface. The force sensor information is used to align a structure comprising the item with a corresponding cavity comprising the slot, and the item is inserted into the slot.

Robotic kitting machine

A robotic system is disclosed which includes a robotic arm having n degrees of freedom, the robotic arm comprising a base and a set of serially connected links and joints connected to the base; an enabler joint assembly comprising a mounting location at which the base of the robotic arm is mounted and having a rotational axis, offset from the mounting location, about which the enabler joint assembly is configured to rotate the mounting location; and a processor configured to control a first set of motors associated with the n degrees of freedom of the robotic arm and an enabler joint motor comprising the enabler joint assembly to control operation of the robotic arm within an extended operating space defined at least in part by the n degrees of freedom of the robotic arm and an (n+1)degree of freedom provided by the enabler joint assembly.

Robotic system to load and unload trucks and other containers

A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. A grasp strategy is determined for each of at least a subset of items, and for each grasp strategy a corresponding probability of grasp success is computed. The grasp strategies and corresponding probabilities of grasp success are used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

Coordinating multiple robots to meet workflow and avoid conflict

A multicamera image processing system is disclosed. In various embodiments, image data is received from each of a plurality of sensors associated with a workspace, the image data comprising for each sensor in the plurality of sensors one or both of visual image information and depth information. Image data from the plurality of sensors is merged to generate a merged point cloud data. Segmentation is performed based on visual image data from at least a subset of the sensors in the plurality of sensors to generate a segmentation result. One or both of the merged point cloud data and the segmentation result is/are used to generate a merged three dimensional and segmented view of the workspace.

Multicamera image processing

The present application discloses a system, a method, and a computer system for detecting objects that require special handling. The method includes (i) receiving image data from one or more cameras associated with a source conveyor configured to convey items to a pick location, (ii) determining, based at least in part on the image data, that an item requiring special handling has entered the source conveyor, and (iii) providing an output indicating that the item requiring special handling has been detected.

Detection of heavy objects using computer vision

A robotic system to control multiple robots to perform a task cooperatively is disclosed. A first robot determines to perform a task cooperatively with a second robot, moves independently to a first grasp position to grasp an object associated with the task, receives an indication that the second robot is prepared to perform the task cooperatively, and moves the object independently of the second robot in a leader mode along a trajectory determined by the first robot. The second robot assists the first robot in performing the task cooperatively, at least in part by moving independently to a second grasp position, grasping the object, and cooperating with the first robot to move the object, at least in part by operating in a follower mode of operation to maintain engagement with the object as the first robot moves the object along the trajectory.

Robotic system to control multiple robots to perform a task cooperatively

A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. The three dimensional view as generated at successive points in time is used to model a flow of at least a subset of said plurality of items through at least a portion of the workspace. The model is used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

Singulation of arbitrary mixed items

A robotic singulation system is disclosed. In various embodiments, sensor data image data associated with a plurality of items present in a workspace is received. The sensor data is used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workspace and place each item singly in a corresponding location in a singulation conveyance structure. The plan includes performing an active measure to change or adapt to a detected state or condition associated with one or more items in the workspace.

Techniques are disclosed to use a robotic arm to palletize or depalletize diverse items. In various embodiments, data associated with a plurality of items to be stacked on or in a destination location is received. A plan to stack the items on or in the destination location is generated based at least in part on the received data. The plan is implemented at least in part by controlling a robotic arm of the robot to pick up the items and stack them on or in the receptacle according to the plan, including by for each item: using one or more first order sensors to move the item to a first approximation of a destination position for that item at the destination location; and using one or more second order sensors to snug the item into a final position.

Growing community of inventors

Menlo Park, CA, United States of America

Talbot Morris-Downing