Google Inc.

X Development LLC

Other

Niantic, Inc.

Ryan Michael Hickman

James Joseph Kuffner

Arshan Poursohi

Thor Lewis

James Robert Bruce

Anthony Gerald Francis, Jr

Chaitanya Gharpure

Damon Kohler

Munjal Desai

David Robert Black

Soohyun Bae

Brian Patrick Williams

Joel Hesch

Johnny Hsienchow Lee

Johnny Chung Lee

Esha D Nerurkar

James Fung

Simon Lynen

Won S Chun

Xiaoming Chen

Anthony Matt Francis

Girish Deodhar

Patrick Mihelich

James J Kuffner

Anthony Gerald Francis

Laurent Tu

James Kuffner

Anthony G Francis

An example method includes obtaining, obtaining, from one or more sensors of a computing device, data relating to a feature in an environment. Following, the method includes analyzing the data to identify one or more details of the feature in the environment and determining, based on a comparison of the data to a stored dataset in a database, that the details includes a detail that the stored dataset lacks. The method includes providing one or more game elements for gameplay on an interface of the computing device based on the details including the detail that the stored dataset lacks.

Methods and systems for generating detailed datasets of an environment via gameplay

Methods and systems for proactively preventing hazardous or other situations in a robot-cloud interaction are provided. An example method includes receiving information associated with task logs for a plurality of robotic devices. The task logs may include information associated with tasks performed by the plurality of robotic devices. The method may also include a computing system determining information associated with hazardous situations based on the information associated with the task logs. For example, the hazardous situations may comprise situations associated with failures of one or more components of the plurality of robotic devices. According to the method, information associated with a contextual situation of a first robotic device may be determined, and when the information associated with the contextual situation is consistent with information associated with the one or more hazardous situations, an alert indicating a potential failure of the first robotic device may be provided.

Systems and methods for determining a potential failure or other status of a robotic device

Methods and systems for allocating tasks to robotic devices are provided. An example method includes receiving information associated with task logs for a plurality of robotic devices and in a computing system configured to access a processor and memory, determining information associated with a health level for the plurality of robotic devices based on the information associated with the task logs. A health level for a given robotic device may be proportional to a current level of ability to perform a function, which may change over a lifespan of the given robotic device. Information associated with a plurality of tasks to be performed by one or more or the robotic devices may also be determined. The computing system may optimize an allocation of the plurality of tasks such that a high precision task may be allocated to a robotic device having a greater current health level than another robotic device.

Systems and methods for allocating tasks to a plurality of robotic devices

The present application discloses systems and methods for inventorying objects. In one embodiment, a robot detects an object and sends identification data and location data associated with the detected object to a cloud computing system. The identification data may include an image of the object and/or information from a tag, code, or beacon associated with the object. In response to receiving the identification data and the location data, the cloud computing system identifies the object. The cloud computing system may also determine or create a first map associated with the identified object and a second map associated with the identified object. The first map may be associated with the current location of the object and the second map may correspond to a past location of the object. The cloud computing server may compare the first and second maps, and then send instructions to the robot based on the comparison.

Systems and methods for inventorying objects

An example method involves obtaining a log of sensor data indicative of an environment during a prior time period, with the log of sensor data including a sequence of image frames, and determining that the log of sensor data relates to a collision involving a physical object in the environment at a particular time within the prior time period. The method also involves, responsive to determining that the log of sensor data relates to the collision, generating a training data set for the collision from the log of sensor data. The training data set for the collision may include multiple image frames of the sequence of image frames that are prior to an image frame in the sequence of image frames that corresponds to the particular time.

Collision detection, estimation, and avoidance

An example method includes obtaining, from a camera of a computing device, an image of an environment and then determining, based on a first comparison of the image to a stored dataset in a database, that the stored dataset lacks one or more details of the environment. Following, the method includes providing a command by the computing device that indicates a request to obtain additional data of the environment, and in response to the command, obtaining, from one or more sensors of the computing device, additional data of the environment. The method also includes determining, based on a second comparison to the stored dataset in the database, that the additional data of the environment differs from data of the environment in the stored dataset, and then providing one or more points for gameplay on an interface of the computing device.

Methods and systems for selecting a velocity profile for controlling a robotic device are provided. An example method includes receiving via an interface a selection of a robotic device to control, and receiving via the interface a request to modify a velocity profile of the robotic device. The velocity profile may include information associated with changes in velocity of the robotic device over time. The method may further include receiving a selected velocity profile, receiving an input via the interface, and determining a velocity command based on the selected velocity profile and the input. In this manner, changes in velocity of the robotic device may be filtered according to a velocity profile selected via the interface.

Methods and systems for selecting a velocity profile for controlling a robotic device

An electronic device includes at least one sensor, a display, and a processor. The processor is configured to determine a dimension of a physical object along an axis based on a change in position of the electronic device when the electronic device is moved from a first end of the physical object along the axis to a second end of the physical object along the axis. A method includes capturing and displaying imagery of a physical object at an electronic device, and receiving user input identifying at least two points of the physical object in the displayed imagery. The method further includes determining, at the electronic device, at least one dimensional aspect of the physical object based on the at least two points of the physical object using a three-dimensional mapping of the physical object.

Measuring dimension of object through visual odometry

Methods and systems for determining states of environments and modifying the environments according to the states are disclosed. In one aspect, the method includes a robot device determining for an environment a state comprising a plurality of state attributes for the environment. The method further includes receiving a request for the state and, in response to receiving the request, modifying the environment to comprise at least some of state attributes. The robot device may determine the state by receiving indications of at least some of the state attributes from some or all of a user, a server, another robot device, and another device. The attributes may be user attributes for a particular user, or may be event attributes for a particular type of event. The request may take the form of a request from a user, a calendar event, or a user arrival.

Determining states and modifying environments according to states

Methods and devices are disclosed for monitoring environmental conditions in one or more environments. In one embodiment, the method includes maintaining a plurality of environmental-condition thresholds, each of which corresponds to an environmental condition and is predetermined based on data corresponding to the environmental condition that is received from a plurality of robots. The method further includes receiving from a first robot first data corresponding to a first environmental condition in a first environment. The method may still further include making a first comparison of the first data and a first environmental-condition threshold corresponding to the first environmental condition and, based on the first comparison, triggering a notification. Triggering the notification may comprise transmitting to the robot instructions to transmit the notification to at least one of a call center and a remote device.

Systems and methods for using robots to monitor environmental conditions in an environment

Multirobotic management can involve communications between a command or leader robot and one or more client or follower robots through a cloud computing system. In an example implementation, a leader robot can receive first sensory data captured by a first follower robot and second sensory data captured by a second follower robot, determine a command function based on at least one of the first sensory data and the second sensory data, and communicate with at least one of the first follower robot and the second follower robot based on the command function.

Methods and systems for multirobotic management

According to a general aspect, a method can include receiving a request, triggered via a consumer account, to access, using a social media application, a plurality of sharer content. The sharer content can be associated with a sharer account using the social media application. The method can include retrieving, in response to the request, a consumer value and a relationship value. The consumer value can represent an interaction with the social media application via the consumer account and the relationship value can characterize a relationship between a consumer identifier of the consumer account and a sharer identifier of the sharer account. The method can include selecting a subset of sharer content from the plurality of sharer content based on a combination of the consumer value and the relationship value, and can include defining a portion of a presentation customized for the consumer account using the selected subset of sharer content.

Composition of customized presentations associated with a social media application

A mobile device includes at least one imaging sensor to capture imagery of an environment of the mobile device, a privacy filter module, a spatial feature detection module, an assembly module, and a network interface. The privacy filter module is to perform at least one image-based privacy filtering process using the captured imagery to generate filtered imagery. The spatial feature detection module is to determine a set of spatial features in the filtered imagery. The assembly module is to generate an area description file representative of the set of spatial features. The network interface is to transmit the area description file to a remote computing system. The assembly module may select only a subset of the set of spatial features for inclusion in the area description file.

Growing community of inventors

Sunnyvale, CA, United States of America

Ryan Michael Hickman