X Development LLC

Redwood Robotics Inc.

Fetch Robotics, Inc.

Google Inc.

Claryo, Inc.

Zebra Technologies Corporation

Stefan Nusser

Aaron Ladd Edsinger

Advait Jain

John William Zevenbergen

Troy Straszheim

James Nicholas Vines

Anthony Rizzi Jules

Ethan Rublee

Melonee Wise

David Dymesich

David Robson

Brian Cairl

Levon Avagyan

Niharika Arora

Aaron Hoy

Carl Saldanha

Robert Chatman, Iii

Anthony Sean Jules

Kevin William Watts

Dylan Bourgeois

Pierre-Emmanuel Evreux

Mohamed Amer

Sarah Elliott

Kyle Marshall

David Lin

Robert Lang

Attila Kabai

Uwe Meister

Mason Cole

Josh Staker

Lonai Anthraper

Louis Abastas

Nick Vander Valk

A method includes: obtaining a task definition for a mobile robot, the task definition including (i) a position on an item support carried by the mobile robot, and (ii) an identifier of an item to be placed at the position to form a unit load with the item support; controlling the mobile robot carrying the item support to travel to a pick location for receiving the item from a picker; controlling an output device to render an indication of the position for the picker at the pick location; responsive to placement of the item at the position by the picker, controlling the mobile robot to travel to a handling location.

Automated unit load fulfillment methods and systems

A virtual facility system may include a storage system, a data engine, an integration system, a virtual facility interface system, and a simulator engine. The storage system may store data including video of the real facility. The data engine may train a neural rendering model of the real facility based on the data providing a photorealistic three-dimensional representation of the real facility. The integration system may provide one or more interfaces facilitating communication with one or more control systems associated with the real facility including a management system providing historical or live inventory tracking data and facility operations process data characterizing of locations and tasks corresponding with inventory items or materials stored or handled in the real facility. The virtual facility interface system may provide access to information stored in a virtual facility. The simulator engine may simulate novel views generated based on the neural rendering model.

Systems and methods for photorealistic image data simulation and monitoring in a virtual facility

A virtual facility robotics system may include a storage system, a data engine, an integration system, a virtual facility interface system, and a simulator engine. The storage system may store video data of a real facility. The data engine may train a neural rendering model providing a photorealistic three-dimensional representation of the real facility. The integration system may provide facilitate communication with a robot fleet manager configured to control one or more robots operating within the real facility. The virtual facility interface system may provide access to information stored in a virtual facility that includes the photorealistic three-dimensional representation of the real facility. The virtual facility interface system may be configured to provide information to the robot fleet manager via the integration system upon request. The simulator engine may simulate a future state of the real facility including one or more novel views generated based on the neural rendering model.

Systems and methods for a virtual facility supporting robotics fleet control and sensor data simulation

A system for facility monitoring and reporting to improve safety using one or more robots includes: a network; a plurality of autonomous mobile robots operating in a facility, the robots configured to monitor facility operation, the robots further configured to detect a predetermined critical condition, the robots operably connected to the network; a server operably connected to the robots over the network; and an individual robot operably connected to the server over the network, the individual robot operating in the facility, the robots not comprising the individual robot, the individual robot configured to monitor facility operation; wherein the robots are configured to regularly produce a regular report under normal operating conditions, the report displaying data received from the server, wherein the robots are further configured to produce to the server a critical condition report upon occurrence of the critical condition.

Method and system for facility monitoring and reporting to improve safety using robots

A system is provided, including one or more servers in communication with a robotic system. The one or more servers may be configured to receive operational data from the robotic system, and determine one or more operational performance metrics based on the received operational data. The system may also include a first computing device in communication with the robotic system including a workstation authoring software application configured to program the given task to be completed by the robotic system, and determine one or more subtasks required for the robotic system to perform the given task. The system may also include a second computing device in communication with the robotic system including an operational dashboard software application configured to control various operations of the robotic system, and provide for display a visual representation of the operational data and the operational performance metrics on an interface of the second computing device.

Distributed system for management and analytics of robotic devices

An example modular reconfigurable workcell for quick connection of peripherals is described. In one example, a modular reconfigurable workcell comprises modular docking bays on a surface of the workcell that support attachment of docking modules in a fixed geometric configuration, and respective modular docking bays include electrical connections for a variety of power and communication busses of the docking modules to be attached. The workcell also includes an electrical subsystem for coupling the communication busses between the modular docking bays and providing power circuitry to the modular docking bays, and structural features in the modular docking bays to enable insertion of the docking modules in the fixed geometric configuration. The workcell also includes a processor for determining a geometric calibration of attached peripherals based on a location and the orientation of corresponding docking modules attached to the modular docking bays and based on an identification of the attached peripherals.

Modular reconfigurable workcell for quick connection of peripherals

A method operable by a computing device is provided. The method may include receiving a request for a given task to be performed by a modular reconfigurable workcell. The method may also include determining one or more peripherals required to perform the given task. The method may also include determining an optimal placement of the one or more peripherals based on the given task, wherein the one or more peripherals are coupled to the workcell in a fixed geometric configuration based on the determined optimal placement. The method may also include determining a first calibration of the one or more peripherals based on the orientation of the one or more peripherals relative to the workcell, and determining a second calibration of the one or more peripherals based on the optimal placement of the one or more peripherals with respect to each other.

Methods and systems for rapid configuration, calibration, and deployment of a modular reconfigurable mounting structure

Example systems and methods may provide for a heterogeneous fleet of robotic devices for collaborative object processing in an environment, such as a warehouse. An example system includes a plurality of mobile robotic devices configured to transport one or more objects within an environment, a fixed robotic manipulator positioned within the environment that is configured to manipulate one or more objects within an area of reach of the fixed robotic manipulator, and a control system. The control system may be configured to cause one or more of the plurality of mobile robotic devices to deliver at least one object to at least one location within the area of reach of the fixed robotic manipulator, and to cause the fixed robotic manipulator to distribute the at least one object to a different one or more of the plurality of mobile robotic devices for delivery to one or more other locations within the environment.

Heterogeneous fleet of robots for collaborative object processing

An example apparatus includes an enclosed rectangular container, including an openable first end and an openable second end. The apparatus further includes at least one first supporting base positioned proximate to the first end of the container that has an adjustable height in order to align a floor of the container with a trailer. The apparatus also includes at least one second supporting base positioned proximate to the second end of the container that has an adjustable height in order to align the floor of the container with a loading dock. The apparatus additionally includes a robotic manipulator connected to the floor of the container that is configured to move one or more objects between the trailer and the loading dock by moving the one or more objects through the container when the first end and the second end of the container are opened.

Modular dock for facilities integration

Methods and systems for rapid configuration, calibration, and deployment of a modular robot workcell

Methods and systems for distributing remote assistance to facilitate robotic object manipulation are provided herein. Regions of a model of objects in an environment of a robotic manipulator may be determined, where each region corresponds to a different subset of objects with which the robotic manipulator is configured to perform a respective task. Certain tasks may be identified, and a priority queue of requests for remote assistance associated with the identified tasks may be determined based on expected times at which the robotic manipulator will perform the identified tasks. At least one remote assistor device may then be requested, according to the priority queue, to provide remote assistance with the identified tasks. The robotic manipulator may then be caused to perform the identified tasks based on responses to the requesting, received from the at least one remote assistor device, that indicate how to perform the identified tasks.

Methods and systems for distributing remote assistance to facilitate robotic object manipulation

Distributed system for management and analytics of robotics devices

Growing community of inventors

Palo Alto, CA, United States of America

Stefan Nusser