Dexterity, Inc.

Samir Menon

Zhouwen Sun

Kevin Jose Chavez

Harry Zhe Su

Talbot Morris-Downing

Rohit Arka Pidaparthi

Robert Hegdahl

Yuan Gao

Ayush Sharma

Raphael Georg Wirth

Gerald Brantner

Robert Holmberg

Ben Varkey Benjamin Pottayil

David Leo Tondreau, Iii

Toby Leonard Baker

Roger Lam Hau

Cyril Nader

Cuthbert Sun

William Arthur Clary

Alberto Leyva Arvayo

Farshid Farhat

Rohun Kulkarni

Michael Fisher

Ivan Alberto Trujillo Priego

Andrew Lovett

Timothy Andrew Ryan

Andrew Nguyen

David Turney

Kevin Chavez

Rohit Pidaparthi

Ben Varkey Pottayil

A kitting system is disclosed. In various embodiments, the kitting system includes a conveyance structure configured to impart to an item a first net resultant force substantially in a first direction, wherein the first direction is associated with a direction of flow from a source end of the conveyance structure to a destination end opposite the source end and associated with a pick-up zone from which the item is to be retrieved; a sensor configured to provide a sensor output associated with the pick-up zone; and a processor configured to provide a control input to one or both of the conveyance structure and a disrupter device associated with the conveyance structure based at least in part on the sensor output.

Robotic kitting system

A robot is operated in an autonomous mode of operation to perform a plurality of tasks. It is determined that a later task of the plurality of tasks needs human assistance while performing a current task of the plurality of tasks. The human assistance is scheduled for the later task. A teleoperator is communicated with to perform the human assistance associated with the later task.

Autonomous robot with on demand teleoperation

A robotic system is disclosed comprising a communication interface and a processor coupled to the communication interface and configured to: receive via the communication interface an indication to establish a conveyance path to convey one or more items from a source location at an originating end of the conveyance path to a destination location at a terminating end of the conveyance path; determine programmatically a plan to arrange and configured one or more conveyance structures to provide the conveyance path; and invoke one or more robots to position, couple as needed, and configure as needed the one or more conveyance structures to provide the conveyance path.

Interoperable robotic system to load/unload trucks and other containers

A plurality of sensors are configured to provide a corresponding output that reflects a sensed value associated with engagement of a robotic arm end effector with an item. The respective outputs of one or more sensors comprising the plurality of sensors are used to determine one or more inputs to a multi-modal model configured to provide, based at least in part on the one or more inputs, an output associated with slippage of the item within or from a grasp of the robotic arm end effector. A determination associated with slippage of the item within or from the grasp of the robotic arm end effector is made based at least in part on an output of the multi-modal model. A responsive action is taken based at least in part on the determination associated with slippage of the item within or from the grasp of the robotic arm end effector.

Detecting slippage from robotic grasp

A set of one or more potentially graspable features for one or more objects present in a workspace area are determined based on visual data received from a plurality of cameras. For each of at least a subset of the one or more potentially graspable features one or more corresponding grasp strategies are determined to grasp the feature with a robotic arm and end effector. A score associated with a probability of a successful grasp of a corresponding feature is determined with respect to each of a least a subset of said grasp strategies. A first feature of the one or more potentially graspable features is selected to be grasped using a selected grasp strategy based at least in part on a corresponding score associated with the selected grasp strategy with respect to the first feature. The robotic arm and the end effector are controlled to attempt to grasp the first feature using the selected grasp strategy.

Autonomous unknown object pick and place

Techniques are disclosed to use robotic system simulation to control a robotic system. In various embodiments, a communication indicating an action to be performed by a robotic element is received from a robotic control system. Performance of the action by the robotic element is simulated. A state tracking data is updated to reflect a virtual change to one or more state variables as a result of simulated performance of the action. Successful completion of the action by the robotic element is reported to the robotic control system.

Robotic system simulation engine

A kitting machine is disclosed. In various embodiments, the machine includes an actuator configured to move a surface or receptacle to a position associated with item retrieval; and a controller configured to control operation of the actuator to position an item in the position associated with item retrieval, in a manner that is synchronized at least in part with operation of a robotic retrieval device configured to retrieve the item from the position associated with item retrieval.

Kitting machine

A robotic kitting machine is disclosed. In various embodiments, a robotic arm is used to move an item to a location in proximity to a slot into which the item is to be inserted. Force information generated by a force sensor is received via a communication interface. The force sensor information is used to align a structure comprising the item with a corresponding cavity comprising the slot, and the item is inserted into the slot.

Robotic kitting machine

A robotic system is disclosed which includes a robotic arm having n degrees of freedom, the robotic arm comprising a base and a set of serially connected links and joints connected to the base; an enabler joint assembly comprising a mounting location at which the base of the robotic arm is mounted and having a rotational axis, offset from the mounting location, about which the enabler joint assembly is configured to rotate the mounting location; and a processor configured to control a first set of motors associated with the n degrees of freedom of the robotic arm and an enabler joint motor comprising the enabler joint assembly to control operation of the robotic arm within an extended operating space defined at least in part by the n degrees of freedom of the robotic arm and an (n+1)degree of freedom provided by the enabler joint assembly.

Robotic system to load and unload trucks and other containers

A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. A grasp strategy is determined for each of at least a subset of items, and for each grasp strategy a corresponding probability of grasp success is computed. The grasp strategies and corresponding probabilities of grasp success are used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

Coordinating multiple robots to meet workflow and avoid conflict

A multicamera image processing system is disclosed. In various embodiments, image data is received from each of a plurality of sensors associated with a workspace, the image data comprising for each sensor in the plurality of sensors one or both of visual image information and depth information. Image data from the plurality of sensors is merged to generate a merged point cloud data. Segmentation is performed based on visual image data from at least a subset of the sensors in the plurality of sensors to generate a segmentation result. One or both of the merged point cloud data and the segmentation result is/are used to generate a merged three dimensional and segmented view of the workspace.

Multicamera image processing

A robotic system to control multiple robots to perform a task cooperatively is disclosed. A first robot determines to perform a task cooperatively with a second robot, moves independently to a first grasp position to grasp an object associated with the task, receives an indication that the second robot is prepared to perform the task cooperatively, and moves the object independently of the second robot in a leader mode along a trajectory determined by the first robot. The second robot assists the first robot in performing the task cooperatively, at least in part by moving independently to a second grasp position, grasping the object, and cooperating with the first robot to move the object, at least in part by operating in a follower mode of operation to maintain engagement with the object as the first robot moves the object along the trajectory.

Robotic system to control multiple robots to perform a task cooperatively

A robot configured to use a gripper to grasp one or more tools is disclosed. In various embodiments, the robot comprises a robotic arm having a gripper disposed at a free moving end of the robotic arm, and a set of two or more tools configured to grasped or otherwise engaged by the gripper. Each tool in the set of two or more tools may be disposed in a corresponding tool holder, optionally attached to the robot or situated near the robot. The robot is configured to use the gripper to retrieve a selected tool from its tool holder to perform a task; use the tool to perform the task; and return the tool to its tool holder.

Robotic toolset and gripper

A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. The three dimensional view as generated at successive points in time is used to model a flow of at least a subset of said plurality of items through at least a portion of the workspace. The model is used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

Singulation of arbitrary mixed items

A velocity control-based robotic system is disclosed. In various embodiments, sensor data is received from one or more sensors deployed in a physical space in which a robot is located. A processor is used to determine based at least in part on the sensor data an at least partly velocity-based trajectory along which to move an element comprising the robot. A command to implement the velocity-based trajectory is sent to the robot.

Growing community of inventors

Palo Alto, CA, United States of America

Samir Menon