Apple Inc.

Aitor Aldoma Buchaca

Oliver Montague Welton Dunkley

Michael Jaison Gnanasekar

Oliver Montague Dunkley

Giancarlo Yerkes

Na Wong

Oliver Thomas Ruepp

Jai Prakash

An electronic device: obtains a plurality of sets of images; synthesizes a three-dimensional point cloud for each of the plurality of sets of images; constructs planes using the respective three-dimensional point clouds; and generates a merged set of quadtrees characterizing a merged set of planes across the three-dimensional point clouds.

Method and device for detecting planes and/or quadtrees for use as a virtual substrate

In one implementation, a method of generating a horizontal plane hypothesis includes obtaining a point cloud of a scene including a plurality of points in a gravity-aligned coordinate system. The method includes generating, based on the plurality of points, a height histogram indicative of a plurality of non-overlapping height ranges in the gravity-aligned coordinate system and a respective plurality of weights. The method includes generating one or more horizontal plane hypotheses based on the height histogram.

Planar surface detection

In accordance with some embodiments, a method is performed at a device with one or more processors, non-transitory memory, and an image sensor. The method includes synthesizing, from image data that corresponds to a physical perspective of an object relative to the device, a surface mask characterizing a portion of a surface of the object based on a grid arranged on the object, wherein the grid is represented in the image data. The method includes generating a virtual perspective of a model associated with the object having a surface oriented to match the surface mask within a predefined confidence threshold.

Method and device for detection and tracking of low-texture objects

Implementations disclosed herein more accurately and efficiently identify planar region boundaries corresponding to surfaces in a physical environment based on identifying intersections. In some implementations a detected planar region is altered, e.g., trimmed or extended, based on detecting an intersection of the planar region with an expansion of another planar region. In other implementations, a detected planar region is altered, e.g., trimmed or extended, based on detecting an intersection of the planar region with a detected edge line.

Planar region boundaries based on intersection

An electronic device: displays, on a display of the electronic device, a reticle element in a first appearance state overlaid on a media capture preview of objects in a field of view of an image sensor of the electronic device, where the media capture preview changes as the objects in the field of view of the image sensor change; detects a plane in the media capture preview; and, in response to detecting the plane, displays, on the display, the reticle element in a second appearance state overlaid on the media capture preview, where the reticle element corresponds to an indication of a portion of the extent of the plane while displayed in the second appearance state.

Growing community of inventors

Los Gatos, CA, United States of America

Aitor Aldoma Buchaca