Matterport, Inc.

Flashfoto, Inc.

Daniel Prochazka

Matthew Tschudy Bell

Brian Schulman

Peter McColgan

James Mildrew

James Sundra

Dustin Michael Cook

Alan Tan

Preston Cowley

Lester Lee

Robinson Piramuthu

Kuang-chih Lee

Katharine Ip

This application generally relates to defining, displaying and interacting with tags in a 3D model. In an embodiment, a method includes generating, by a system including a processor, a three-dimensional model of an environment based on sets of aligned three-dimensional data captured from the environment, and associating tags with defined locations of the three-dimensional model, wherein the tags are respectively represented by tag icons that are spatially aligned with the defined locations of the three-dimensional model as included in different representations of the three-dimensional model rendered via an interface of a device, wherein the different representations correspond to different perspectives of the three-dimensional model, and wherein selection of the tag icons causes the tags respectively associated therewith to be rendered at the device.

Defining, displaying and interacting with tags in a three-dimensional model

Systems for refinement of a segmentation of an image using spray-paint markup are disclosed, with methods and processes for making and using the same. Spray-paint markup allows for easy markup of errors in a segmentation. The markup's data may be correlated or harmonized with the representation of the segmentation, such that it may be applied to the segmentation. The markup's data is utilized to refine the segmentation errors. To assist in the refinement process, the resolutions may be scaled down so as to exert less computation burden during the process.

Refinement of segmentation markup

Systems for segmenting human hairs and faces in color images are disclosed, with methods and processes for making and using the same. The image may be cropped around the face area and roughly centered. Optionally, the illumination environment of the input image may be determined. If the image is taken under dark environment or the contrast between the face and hair regions and background is low, an extra image enhancement may be applied. Sub-processes for identifying the pose angle and chin contours may be performed. A preliminary mask for the face by using multiple cues, such as skin color, pose angle, face shape and contour information can be represented. An initial hair mask by using the abovementioned multiple cues plus texture and hair shape information may be created. The preliminary face and hair masks are globally refined using multiple techniques.

Segmenting human hairs and faces

Systems, methods, and computer readable media for forming a mugshot from a digital color image are provided in which a dominant face is determined using the digital color image. Person segmentation is also performed using the digital color image. An image and a mask are cropped based on the dominant face thereby forming a cropped image. Rough segmentation is performed on the cropped image. A mask is averaged in projection space based on the cropped image. The mask is refined mask and prepared for the mugshot.

Image segmentation

Growing community of inventors

Pacifica, CA, United States of America

Daniel Prochazka