X Development LLC

Redwood Robotics Inc.

Verily Life Sciences LLC

Intrinsic Innovation LLC

Other

Anthony Sean Jules

Jeff Linnell

Jeffrey Linnell

Aaron Ladd Edsinger

Johan Ulrich Lewin Jessen

Marek Piotr Michalowski

Advait Jain

Kendra Byrne

Eli Reekmans

Michael Kolb

Benjamin M Davis

Brandon Kruysman

Jonathan Proto

Matthew A Bitterman

Stefan Nusser

Michael Beardsworth

James Nicholas Vines

Example implementations relate to punch-in transitions to smoothly transition operation of parts of a robotic system from control tracks to real-time input, such as to smoothly transition a control track rotating a knob at a handheld controller to real-time input received at the handheld controller. Similarly, example implementations relate to punch-out transitions to smoothly transition operation of parts of a robotic system from real-time input to control tracks, such as to smoothly transition from the real-time input received at a handheld controller to a control track rotating a knob at a handheld controller. In particular, an example system may include a handheld haptic controller, a control system, and a robotic component.

Punch-in / punch-out smoothing for takeover of automated movement with haptic controller

Example implementations may relate to optimization of observer robot locations. In particular, a control system may detect an event that indicates desired relocation of observer robots within a worksite. Each such observer robot may have respective sensor(s) configured to provide information related to respective positions of a plurality of target objects within the worksite. Responsively, the control system may (i) determine observer robot locations within the worksite at which one or more of the respective sensors are each capable of providing information related to respective positions of one or more of the plurality of target objects and (ii) determine a respectively intended level of positional accuracy for at least two respective target objects. Based on the respectively intended levels of positional accuracy, the control system may select one or more of the observer robot locations and may direct one or more observer robots to relocate to the selected locations.

Optimization of observer robot locations

In one aspect, a method is described. The method may include providing an end effector tool of a robotic device configured to perform a task on a work surface within a worksite coordinate frame. The method may further include providing first location data indicating a first location of the end effector tool with respect to the work surface, providing second location data indicating a second location of the end effector tool within the worksite coordinate frame, and providing third location data indicating a third location of the end effector tool within the worksite coordinate frame. The method may further include tracking the location of the end effector tool based on the first, second, and third location data, and, based on the tracked location of the tool, instructing the robotic device to manipulate the end effector tool to perform a task on the work surface.

Multi-resolution localization system

Example implementations may relate to a haptic hand-holdable controller. In particular, an example device may take the form of a haptic controller, which senses tactile information and provides force feedback for a more intuitive user experience. The force feedback may indicate a state of the device that is being controlled. An example haptic handheld controller may be utilized to manipulate data input to a robot, a tablet computer, and/or any other type of computing device. In an example embodiment, the haptic handheld controller may be such that the controller indicates to the user what manipulation of different types of data feels like, for example, by using operating modes for the haptic handheld controller where a motor varies feedback to the handheld controller.

Haptic controller with touch-sensitive control knob

A robotic system includes end-effector(s) that combine a plurality of objects in a production process. The system includes sensor(s) that obtain measurement(s) relating to a combination of a first object and one or more other objects during the production process. The system includes a control system communicatively coupled to the sensor(s). The control system stores specifications relating to the combination of the plurality of objects. The control system receives the measurement(s) from the sensor(s), determines a difference based on the measurement(s) and the specifications, determines adjustment(s) to the production process based on the determined difference, and sends, for the end-effector(s), instruction(s) based on the specifications and the one or more adjustment(s). The end-effector(s) combine a second object with the first object and the one or more objects based on the specifications and the one or more adjustment(s).

Error accrual and mitigation during robotic process

A robotic system includes one or more end-effectors that combine, according to a production process, at least one object and structure(s) at a production site. Sensor(s) generate, from the production site, sensor data relating to the production process. A control system stores specifications for the production process based on a model of the production site and/or the at least one object. The control system: receives, from the sensor(s), the sensor data; determines, from the sensor data, properties of at least one of: the production site or the at least one object; determines difference(s) between the properties and the model; determine(s) adjustment(s) to the production process based on the difference(s); and sends, for the end-effector(s), instruction(s) for combining the at least one object and the structure(s) based on the specifications and the one or more adjustments to the production process.

Customized robotic installation based on measurements collected on site

Robotic control systems and methods may include providing an end effector tool of a robotic device configured to perform a task on a work surface within a worksite coordinate frame. Unintended movement over time of the end effector tool with respect to the work surface and with respect to the worksite coordinate frame may be determined based on image data indicative of the work surface, first location data indicative of a first location of the end effector tool with respect to the worksite coordinate frame, and second location data indicative of a second location of the end effector tool with respect to the work surface. One or more control signals for the robotic device may be adjusted in order to counteract the unintended movements of the end effector tool with respect to the work surface and worksite coordinate frame.

Tooltip stabilization

A method operable by a computing device is provided. The method may include receiving a request for a given task to be performed by a robotic system. The method may also determining one or more subtasks required to perform the given task, where the one or more subtasks include one or more parameters used to define the one or more subtasks. The method may also include determining an arrangement of the one or more subtasks to perform the given task, and providing for display an indication of the one or more undefined parameters for the given task. The method may also include receiving an input defining the one or more undefined parameters for the given task, and executing the one or more subtasks in the determined arrangement and in accordance with the one or more defined parameters to cause the robotic system to perform the given task.

Methods and systems for tiered programming of robotic device

Methods, apparatus, systems, and computer-readable media are provided for determining, based on a task to be performed by a robot and past behavior by robots while performing tasks similar to the task, a suggested task-level movement parameter for application to movement of the robot while performing the task; providing output indicative of the suggested task-level movement parameter; receiving input indicative of user selection of the suggested task-level movement parameter or a user-defined task-level movement parameter; determining, based on the received input, an actual task-level movement parameter to be applied to movement of the robot while performing the task; and identifying, based on the actual task-level movement parameter, a plurality of component-level movement parameters to be applied to a plurality of motion primitives implemented by one or more operational components of the robot to perform the task.

Suggesting, selecting, and applying task-level movement parameters to implementation of robot motion primitives

Methods and apparatus that adapt programming and/or control of a robot. The robot has at least one attachment area that can removably couple with any one of a plurality of end effectors. The programming and/or control is adapted based on received parameters of an end effector attached (or to be attached) to the attachment area of the robot. Some implementations are directed to adapting graphical user interface output of a robot programming application based on one or more parameters of an end effector for a robot being programmed via the robot programming application. Some implementations are directed to adapting control of a robot based on one or more parameters of an end effector attached (or to be attached) to the robot.

Growing community of inventors

Oakland, CA, United States of America

Anthony Sean Jules