Google Inc.

Toyota Research Institute, Inc.

X Development LLC

Third Wave Automation, Inc.

Arshan Poursohi

Ryan Michael Hickman

James Robert Bruce

Anthony Gerald Francis, Jr

James Joseph Kuffner

Thor Lewis

Matthew W Amacker

Chaitanya Gharpure

Daniel A Aden

Greg Joseph Klein

Paul Vincent Byrne

Steve Scott Tompkins

Paul Du Bois

Charles Robert Barker

Allison Thackston

Samuel Zapolsky

Damon Kohler

Jonathan Yao

Christian Frueh

Kevin Stone

Manuel Ahumada

Won S Chun

Sumit Jain

Anthony Matt Francis

James J Kuffner

Ken Conley

Charles Robert Barker, Jr

Anthony Gerald Francis

Julian Mason

James Kuffner

James Davidson

Daniel Aden

A robot agent () includes an electro-mechanical subsystem (), a sensor subsystem () having one or more sensors, and a computer hardware subsystem () to execute one or more sets of executable instructions (). The one or more sets of executable instructions manipulate the robot agent to predict an action to be implemented by the robot agent in performing a task () and predict whether the robot agent will fail in performing the action. The one or more sets of executable instructions further manipulate the robot agent to, responsive to predicting the robot agent will fail in performing the action, obtain guidance input () for the first action from at least one guidance source, the guidance input representing guidance for performing the action by the robot agent, and manipulate the electro-mechanical subsystem to perform the action using the guidance input.

Continual proactive learning for autonomous robot agents

A method includes receiving, from a subscriber device, a request including virtual region characteristics and an occupancy threshold, and determining, using image data captured by a camera and the virtual region characteristics, a virtual region corresponding to a portion of a physical region within a field of view of the camera. The virtual region is smaller than the physical region. The method also includes determining, using the image data, an occupancy of the virtual region and determining that the occupancy of the virtual region satisfies the occupancy threshold. In response to determining that the occupancy of the virtual region satisfies the occupancy threshold, the method also includes generating a notification to the subscriber device.

Trigger regions

A computing device configured to display a virtual representation of an environment of a robot includes a display device, a memory, and a processor coupled to the memory. The processor is configured to receive data from the one or more sensors of the robot with respect to an object within an environment of the robot. The processor is also configured to display a virtual representation of the object within a virtual mapping of the environment based on the data received from the one or more sensors. The processor is further configured to receive input data selecting the virtual representation of the object. The processor is also further configured to send instructions to the robot to act in response to the received input data.

Augmented reality overlay

Example implementations may relate to methods and systems for detecting an event in a physical region within a physical space. Accordingly, a computing system may receive from a subscriber device an indication of a virtual region within a virtual representation of the physical space such that the virtual region corresponds to the physical region. The system may also receive from the subscriber a trigger condition associated with the virtual region, where the trigger condition corresponds to a particular physical change in the physical region. The system may also receive sensor data from sensors in the physical space and a portion of the sensor data may be associated with the physical region. Based on the sensor data, the system may detect an event in the physical region that satisfies the trigger condition and may responsively provide to the subscriber a notification that indicates that the trigger condition has been satisfied.

Systems and methods for perception-based tactile sensing in a robot are provided. The robot may include an external portion and an illuminator that outputs illumination. The robot may further include a receiving sensor that receives illumination. The robot may also include a pair of conduits, located at an external portion, that include an injecting conduit that traverses one or more housings of the robot. The injecting conduit may be configured to receive the illumination from the illuminator and output the illumination to illuminate an object external to the robot. The pair of conduits may also include a receiving conduit, traversing one or more housings of the robot, configured to receive the illumination from the object external to the robot and output the illumination to the receiving sensor.

Robots with perception-based fiber-optic tactile sensing and methods for providing the same

Robotic gripper fingers are disclosed. A gripper assembly includes a first finger defining a first object engagement face and a second finger defining a second object engagement face. The first object engagement face of the first finger opposes the second object engagement face of the second finger. The gripper assembly also includes at least one actuator in communication with the first finger that is configured to actuate the first finger relative to the second finger. The gripper assembly includes at least one first sensor facing outward from the first object engagement face. The at least one first sensor is configured to detect objects to be manipulated by actuating the first finger relative to the second finger.

Robotic gripper fingers

A non-backdrivable passive balancing system for a single-axle dynamically balanced robotic device includes a body that includes a distal end and a proximal end, a controller module, and an actuator communicatively coupled to the controller module of the single-axle dynamically balanced robotic device. The actuator receives an engagement signal from the controller module, the engagement signal corresponding to an indication that the dynamically balanced robotic device is stationary, and the actuator causes the linkage to move the body from a disengaged position to an engaged position such that the distal end of the body contacts a ground surface and supports the dynamically balanced robotic device in a substantially upright position.

Non-backdrivable passive balancing systems for single-axle dynamically-balanced robotic devices

Robot systems including a robot, an on-premise computing device, and a cloud services system are disclosed. An on-premise computing device includes a processor and a non-transitory memory device storing machine-readable instructions that, when executed by the processor, cause the processor to receive raw sensor data from a robot, pre-process the sensor data to remove unnecessary information from the sensor data and obtain pre-processed data, transmit the pre-processed data to a cloud services system, receive, from the cloud services system, an object type, an object pose, and an object location of an object corresponding to the pre-processed data, and transmit a signal to the robot based on at least one of the object type, the object pose, and the object location of the object.

Robot systems incorporating cloud services systems

Systems are provided to emit, into an environment of interest, information in the form of modulated optical signals. These optical signals can be provided as illumination from a lighting fixture, display, or other source of environmental illumination. The optical signals can include codes or other information to facilitate location-specific operations of a device that is able to receive the optical signals. This can include receiving information about the location of a light emitter, security credentials or encryption keys, information about services that are available from building automation and/or conferencing systems, or other location-related information. A cellphone or other device receiving such optical signals could then operate to request information related to the received information, to submit commands to control a presentation or conferencing system, to communicate in a secure manner using a received cryptographic key, or to operate in some other way related to location-related information received via optical signals.

Communication to device through lighting control

An example method includes determining a point cloud representation of surfaces within an environment. The method further includes providing for display of a graphical interface that shows a model of the surfaces within the environment based on the point cloud representation. The method additionally includes receiving input data indicating one or more positions for one or more virtual sensors on the graphical interface corresponding to one or more physical positions within the environment. The method also includes determining one or more occluded regions within the environment, where the one or more occluded regions are predicted to be occluded from view by one or more sensors positioned at the one or more physical positions within the environment. The method also includes providing for display in the graphical interface of a graphical representation of the one or more occluded regions within the model of the surfaces within the environment.

Sensor placement interface

Serial communication to device through lighting control

Methods and devices are disclosed for monitoring environmental conditions in one or more environments. In one embodiment, the method includes maintaining a plurality of environmental-condition thresholds, each of which corresponds to an environmental condition and is predetermined based on data corresponding to the environmental condition that is received from a plurality of robots. The method further includes receiving from a first robot first data corresponding to a first environmental condition in a first environment. The method may still further include making a first comparison of the first data and a first environmental-condition threshold corresponding to the first environmental condition and, based on the first comparison, triggering a notification. Triggering the notification may comprise transmitting to the robot instructions to transmit the notification to at least one of a call center and a remote device.

Systems and methods for using robots to monitor environmental conditions in an environment

Systems and devices for acquiring imagery and three-dimensional (3D) models of objects are provided. An example device includes a platform configured to enable an object to be positioned thereon, and a plurality of scanners configured to capture geometry and texture information of the object when the object is positioned on the platform. A first scanner is positioned below the platform so as to capture an image of a portion of an underside of the object, a second scanner is positioned above the platform, and a third scanner is positioned above the platform and offset from a position of the second scanner. The scanners are positioned such that each scanner is outside of a field of view of other scanners. Scanners may include a camera, a light source, and a light-dampening element, and the device may include a control module configured to operate the scanners to individually scan the object.

Systems and devices for acquiring imagery and three-dimensional (3D) models of objects

Growing community of inventors

Berkeley, CA, United States of America

Arshan Poursohi