Apple Inc.

Amit Jain

Alexandre Da Veiga

Qi Shan

Aditya Sankar

Shreyas V Joshi

Afshin Dehghan

Various implementations disclosed herein include devices, systems, and methods that determines two-dimensional (2D) floorplans based on image data and refines the 2D floorplans using various user interface controls. For example, an example process may include obtaining a floorplan that is generated based on a sequence of images of a physical environment, identify a type of an object depicted in the floorplan, identify a context of the object depicted in the floorplan, and modify the floorplan based on the type and the context of the object.

2D floorplan pipeline and refinement

Various implementations disclosed herein include devices, systems, and methods that provide measurements of objects based on a location of a surface of the objects. An exemplary process may include obtaining a three-dimensional (3D) representation of a physical environment that was generated based on depth data and light intensity image data, generating a 3D bounding box corresponding to an object in the physical environment based on the 3D representation, determining a class of the object based on the 3D semantic data, determining a location of a surface of the object based on the class of the object, the location determined by identifying a plane within the 3D bounding box having semantics in the 3D semantic data satisfying surface criteria for the object, and providing a measurement of the object, the measurement of the object determined based on the location of the surface of the object.

Automatic measurements based on object classification

Various implementations disclosed herein include devices, systems, and methods that obtain a three-dimensional (3D) representation of a physical environment that was generated based on depth data and light intensity image data, generate a 3D bounding box corresponding to an object in the physical environment based on the 3D representation, classify the object based on the 3D bounding box and the 3D semantic data, and display a measurement of the object, where the measurement of the object is determined using one of a plurality of class-specific neural networks selected based on the classifying of the object.

Growing community of inventors

San Francisco, CA, United States of America

Amit Jain