X Development LLC

Bot & Dolly, LLC

Intrinsic Innovation LLC

Verily Life Sciences LLC

Autofuss

Kendra Byrne

Jeffrey Linnell

Matthew A Bitterman

Jeff Linnell

Marek Piotr Michalowski

Brandon Kruysman

Eli Reekmans

Jonathan Proto

Anthony Sean Jules

Michael Beardsworth

Ryan Butterfoss

Stoyan Gaydarov

Ytai Ben-Tsvi

Tobias Kinnebrew

Johan Jessen

Asa Hammond

Marek Michalowski

Example systems and methods allow for runtime control of robotic devices during a construction process. One example method includes determining at least one sequence of robot operations corresponding to at least one robot actor, causing the at least one robot actor to execute a portion of the at least one sequence of robot operations during a first time period, receiving an interrupt signal from a mobile computing device indicating a modification to the at least one sequence of robot operations, where the mobile computing device is configured to display a digital interface including one or more robot parameters describing the at least one robot actor and one or more tool parameters describing operating characteristics of at least one physical tool, and causing the at least one robot actor to execute a portion of the at least one modified sequence of robot operations during a second time period.

Runtime controller for robotic manufacturing system

Disclosed herein is a worksite automation process that involves: generating a first sequence of tasks to build the product according to a model. The process further involves causing one or more robotic devices to build the product by beginning to execute the first sequence of tasks. Further, during the execution of the first sequence of tasks, performing a buildability analysis to determine a feasibility of completing the product by executing the first sequence of tasks. Based on the analysis, determining that it is not feasible to complete the product by executing the first sequence of tasks, and in response, generating a second sequence of tasks to complete the product according to the model. Then, causing the one or more robotic devices to continue building the product by beginning to execute the second sequence of tasks.

Planning and adapting projects based on a buildability analysis

Example systems and methods allow for use of a graphical interface to cause one or more robotic devices to construct an output product. One example method includes causing a graphical interface to be displayed on a display device, receiving input data corresponding to one or more interactions with the graphical interface indicating at least one motion path and at least one sequence of tool actions to execute at one or more points within the at least one motion path for use in construction of an output product, generating a plurality of digital nodes including at least one robot node, at least one motion command node, and at least one tool command node, and providing instructions for the at least one robot actor to move according to the sequence of robot motion commands determined by the at least one motion command node and execute the sequence of tool commands determined by the at least one tool command node to construct the output product.

Software interface for authoring robotic manufacturing process

A robotic system includes end-effector(s) that combine a plurality of objects in a production process. The system includes sensor(s) that obtain measurement(s) relating to a combination of a first object and one or more other objects during the production process. The system includes a control system communicatively coupled to the sensor(s). The control system stores specifications relating to the combination of the plurality of objects. The control system receives the measurement(s) from the sensor(s), determines a difference based on the measurement(s) and the specifications, determines adjustment(s) to the production process based on the determined difference, and sends, for the end-effector(s), instruction(s) based on the specifications and the one or more adjustment(s). The end-effector(s) combine a second object with the first object and the one or more objects based on the specifications and the one or more adjustment(s).

Error accrual and mitigation during robotic process

Example implementations may relate to providing a dynamic jig in a three-dimensional (3D) coordinate system. Specifically, a control system may (i) receive task data specifying a manipulation of one or more parts at a specified location; (ii) determine: (a) one or more work surfaces and (b) a first position of each of the one or more work surfaces, such that the one or more work surfaces collectively provide a jig to facilitate the specified manipulation of the parts; (iii) a plurality of guide end effectors that are positionable by one or more robotic devices such that the end effectors provide the work surfaces at the respectively determined first positions; and (iv) operate the one or more robotic devices to position the guide end effectors to provide the one or more work surfaces at the respectively determined first positions, thereby forming the jig from the one or more work surfaces.

Guide placement by a robotic device

A robotic system includes one or more end-effectors that combine, according to a production process, at least one object and structure(s) at a production site. Sensor(s) generate, from the production site, sensor data relating to the production process. A control system stores specifications for the production process based on a model of the production site and/or the at least one object. The control system: receives, from the sensor(s), the sensor data; determines, from the sensor data, properties of at least one of: the production site or the at least one object; determines difference(s) between the properties and the model; determine(s) adjustment(s) to the production process based on the difference(s); and sends, for the end-effector(s), instruction(s) for combining the at least one object and the structure(s) based on the specifications and the one or more adjustments to the production process.

Customized robotic installation based on measurements collected on site

The present application discloses implementations relate to automated generation of interlocking joint features. An example method involves obtaining a virtual model of an object. The virtual model specifies dimensions of a first element, dimensions of a second element, and a spatial relation between the first element and the second element that defines a joint angle. The example method also involves obtaining a relationship that correlates element dimensions and joint angles with cut dimensions. The example method further involves determining cut dimensions for the first element the second element based on the relationship, the dimensions of the first element, the dimensions of the second element, and the joint angle. Modifying the first element and the second element according to the cut dimensions produces interlockable features on the first element and the second element. Additionally, the method involves providing an output signal indicative of the cut dimensions.

Parametric generation of interlocking joints

Example implementations may relate to methods and systems for determining operational modes for a particular arrangement of controllers. Accordingly, a computing device may detect that a first controller is within a threshold distance of a second controller. Responsively, the device may determine a spatial arrangement of the first and second controllers. The device may then determine a set of operational modes that corresponds to the spatial arrangement, where the set includes (i) a first operational mode that corresponds to a first location in the spatial arrangement and (ii) a second operational mode that corresponds to a second location in the spatial arrangement. The device may then load (i) the first operational mode to whichever of the first and second controllers is in the first location and (ii) the second operational mode to whichever of the first and second controllers is in the second location.

Automatic distribution of control functions between multiple knob controllers based on proximity and relative positioning of the knobs

Example implementations may relate to interactive object fabrication. In particular, a control system may receive model data defining a 3D shape of a physical object that is fabricable out of a substrate at a work site. The system may then direct a projection system to emit onto the substrate a projection illustrative of the 3D shape defined by the model data. Also, the system may transmit, to a robotic system, fabrication instructions that direct the robotic system to fabricate the physical object in accordance with the model data. subsequently, during fabrication of the physical object, the system may (i) receive progress data indicative of a portion of the physical object that has been fabricated from the substrate, and (ii) direct the projection system to update the projection of the 3D shape to remove a portion of the projection corresponding to the portion of the physical object that has been fabricated.

Interactive object fabrication

Example systems and methods may allow for closed-loop control of robotic operation. One example method includes receiving input data that identifies data sources to monitor and indicates adjustments to make in response to deviations by at least one of the data sources from at least one predicted state during subsequent execution of sequences of operations by robotic devices, receiving data streams from the data sources during execution of the sequences of operations by the robotic devices, identifying a deviation by one of the data sources from a predicted state for which the received input data indicates adjustments to the sequences of operations for the robotic devices, providing instructions to the robotic devices to execute the adjusted sequences of operations, and providing instructions to a second computing device to update a visual simulation of the robotic devices based on the adjusted sequences of operations.

Closed-loop control system for robotic operation

Example systems and methods may allow for parallel operation of robotic devices within a workcell, such as industrial robots controlled to manufacture an output product. One example method includes receiving ordered sequences of operations for a plurality of corresponding robotic devices, determining time-based sequences of operations for each of the robotic devices, where a time-based sequence of operations indicates positions within the workcell at corresponding timesteps of a global timeline, determining one or more potential collisions involving the robotic devices that would result from parallel execution of the time-based sequences of operations within the workcell, modifying the time-based sequences of operations in order to prevent the one or more potential collisions, and providing instructions for parallel execution of the modified time-based sequences of operations at timesteps of the global timeline by the robotic devices within the workcell.

Growing community of inventors

San Francisco, CA, United States of America

Kendra Byrne