Niantic, Inc.

Soohyun Bae

Ryan Michael Hickman

Daniyar Turmukhambetov

Dung Anh Doan

The present disclosure describes approaches for evaluating interest points for localization uses based on a repeatability of the detection of the interest point in images capturing a scene that includes the interest point. The repeatability of interest points is determined by using a trained repeatability model. The repeatability model is trained by analyzing a time series of images of a scene and determining repeatability functions for each interest point in the scene. The repeatability function is determined by identifying which images in the time series of images allowed for the detection of the interest point by an interest point detection model.

Repeatability predictions of interest points

An example method includes obtaining, obtaining, from one or more sensors of a computing device, data relating to a feature in an environment. Following, the method includes analyzing the data to identify one or more details of the feature in the environment and determining, based on a comparison of the data to a stored dataset in a database, that the details includes a detail that the stored dataset lacks. The method includes providing one or more game elements for gameplay on an interface of the computing device based on the details including the detail that the stored dataset lacks.

Methods and systems for generating detailed datasets of an environment via gameplay

An example method involves obtaining a log of sensor data indicative of an environment during a prior time period, with the log of sensor data including a sequence of image frames, and determining that the log of sensor data relates to a collision involving a physical object in the environment at a particular time within the prior time period. The method also involves, responsive to determining that the log of sensor data relates to the collision, generating a training data set for the collision from the log of sensor data. The training data set for the collision may include multiple image frames of the sequence of image frames that are prior to an image frame in the sequence of image frames that corresponds to the particular time.

Collision detection, estimation, and avoidance

An example method includes obtaining, from a camera of a computing device, an image of an environment and then determining, based on a first comparison of the image to a stored dataset in a database, that the stored dataset lacks one or more details of the environment. Following, the method includes providing a command by the computing device that indicates a request to obtain additional data of the environment, and in response to the command, obtaining, from one or more sensors of the computing device, additional data of the environment. The method also includes determining, based on a second comparison to the stored dataset in the database, that the additional data of the environment differs from data of the environment in the stored dataset, and then providing one or more points for gameplay on an interface of the computing device.

Growing community of inventors

Los Gatos, CA, United States of America

Soohyun Bae