Google Inc.

Stephen Charles Hsu

Daniel Joseph Filip

Vivek Verma

Arthur Robert Pope

Tianqiang Liu

Jacqueline Anne Lai

Meng Yi

Yanxi Liu

Xin Mao

Described is a computer-implemented method which comprises receiving a plurality of images captured by at least one user device, wherein each image is associated with one of a corresponding plurality of geographic locations; determining a path between the plurality of geographic locations; determining a confidence indicator representative of whether the determined path corresponds to a demarked path, wherein determining the confidence indicator comprises determining a time of capture of each of the plurality of images; identifying the path as corresponding to a demarked route, based on the confidence indicator; and marking the plurality of images for display as a demarked route.

Identifying and displaying smooth and demarked paths

This technology relates to optimizing location and orientation information of an image using known locations of places captured within the image. For example, an image and associated pose data including the image's orientation and location may be received. One or more places captured within the image may be determined, with each place having a respective known location. The image may be annotated with the one or more places. A difference between each annotation and its respective known location to obtain updated pose data of the image may be minimized and the associated pose data may be updated to the updated pose data.

Pose estimation of 360-degree photos using annotations

Portion of a display panel with a transitional augmented reality graphical user interface

Systems and methods for generating a composite image from a plurality of source images using a scene dependent multi-band blending operation are provided. The multi-band blending operation implements a filtering operation to reduce blending between objects or surfaces that have natural color and/or brightness differences. More particularly, the typical space invariant upsampling that occurs during multi-band blending can be replaced by a scene dependent filtering operation during upsampling that omits or reduces contributions from pixels associated with different objects in a scene during the multi-band blending process. The scene dependent filtering can be based on scene dependent data, such as height data or slope data, which can be used to identify different objects in a scene.

System and method for scene dependent multi-band blending

The aspects described herein relate to replacing pixels in images in order to remove obstructions from images. In one example, an image of a scene having symmetrical features and image information identifying at least one pixel of the image corresponding to a hole to be filled may be received. This hole may correspond to an obstruction in the image. A set of symmetry axes may be identified based on the symmetrical features. A symmetry map identifying correspondences between different pixels in the image based on the set of symmetry axes may be generated. A correspondence between the at least one pixel corresponding to a hole to be filled and a second pixel of the image is identified based at least in part on the symmetry map and the image information. The at least one pixel may be altered based on the identified correspondence in order to remove the obstruction.

Symmetry-based interpolation in images

An example method and system for blending textures of a composite image formed by a plurality of source images mapped onto a three dimensional model are presented. The composite image is projected to obtain an unblended projected image having textures. The textures are blended to obtain a blended projected image. Both the unblended and the blended projected images are backprojected onto the three dimensional model. A difference is determined between a pixel of the backprojected, blended image and a corresponding pixel of the backprojected, unblended image. The determined difference is then applied to a further corresponding pixel of the composite image to obtain a modified composite image representing a blending of the plurality of source images in the composite image.

Blending 3D model textures by image projection

An exemplary method for simplifying a texture of a three-dimensional model includes simplifying a first three-dimensional model to determine a second three-dimensional model. The first three-dimensional model has a higher resolution than the second three-dimensional model. The method also includes allocating a texture atlas for the second three-dimensional model. The method further includes filling in the texture atlas for the second three-dimensional model. Filling in the texture atlas may include determining a location on the second three-dimensional model corresponding to a pixel in the texture atlas for the second three-dimensional model, determining a location on the first three-dimensional model corresponding to the determined location on the second three-dimensional model, determining a color value texture mapped to the first three-dimensional model at the determined location on the first three-dimensional model, and setting the determined color value to the pixel in the texture atlas for the second three-dimensional model.

Generating reduced resolution textured model from higher resolution model

An exemplary method for simplifying the geometry of a three-dimensional mesh includes dividing a first three-dimensional mesh into a first plurality of tiles along initial boundary lines. The method also includes for at least one tile of the first plurality of tiles, reducing the vertices toward a center of the tile while maintaining vertices along a perimeter of the tile, and assembling the first plurality of tiles to determine a second three-dimensional mesh. The method also includes dividing the second three-dimensional mesh into a second plurality of tiles along boundary lines offset from the initial boundary lines. The method further includes for at least one tile of the second plurality of tiles, reducing the vertices toward a center of the tile while maintaining vertices along a perimeter of the tile, and assembling the second plurality of tiles to determine a simplified three-dimensional mesh.

Growing community of inventors

San Carlos, CA, United States of America

Stephen Charles Hsu