Apple Inc.

Amit Kumar Kc

Daniel Ulbricht

Angela Blechschmidt

Eshan Verma

Tanmay Batra

Mohammad Haris Baig

In one implementation, a method of generating a plane hypothesis is performed by a device including one or more processors, non-transitory memory, and a scene camera. The method includes obtaining an image of a scene including a plurality of pixels. The method includes obtaining a plurality of points of a point cloud based on the image of the scene. The method includes obtaining an object classification set based on the image of the scene. Each element of the object classification set includes a plurality of pixels respectively associated with a corresponding object in the scene. The method includes detecting a plane within the scene by identifying a subset of the plurality of points of the point cloud that correspond to a particular element of the object classification set.

Plane detection using semantic segmentation

In one implementation, a method of generating a plane hypothesis is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, and a scene camera. The method includes obtaining an image of a scene including a plurality of pixels. The method include obtaining a point cloud based on the image of the scene and generating an object classification set based on the image of the scene, each element of the object classification set including a respective plurality of pixels classified as a respective object in the scene. The method includes generating a plane hypothesis based on the point cloud and the object classification set.

In some implementations a neural network is trained to perform to directly predict thin boundaries of objects in images based on image characteristics. A neural network can be trained to predict thin boundaries of objects without requiring subsequent computations to reduce the thickness of the boundary prediction. Instead, the network is trained to make the predicted boundaries thin by effectively suppressing non-maximum values in normal directions along what might otherwise be a thick predicted boundary. To do so, the neural network can be trained to determine normal directions and suppress non-maximum values based on those determined normal directions.

Growing community of inventors

Sunnyvale, CA, United States of America

Amit Kumar Kc