A9.com, Inc.

Amazon Technologies, Inc.

Xing Zhang

Yu Lou

Karl Hillesland

Mukul Agarwal

Jack Mousseau

Kevin May

Simon Fox

Arnab S Dhua

Jesse Chang

Arnab Sanat Kumar Dhua

Amit Kumar K C

Jared Corso

Jason Freund

Jonathan Bernadel-Huey

Geng Yan

Anandram Sundar

Aliaksandr Shchurko

Colin Jon Taylor

Kai Chieh Liu

Himanshu Arora

Rupa Chaturvedi

Asfand Yar Khan

Jason Canada

Nicholas Corso

Chun-Kai Wang

Xi Zhang

Brian Graham

Frank Partalis

Ruokan He

Sanket Radder

Mani Kishore Chitrala

Devices and techniques are generally described for three dimensional room modeling. In various examples, a three-dimensional (3D) room model comprising at least a first wall and a floor may be received. A first sphere sized and shaped such that the 3D room model fits within the first sphere may be determined and a virtual camera may be positioned on the first sphere at a first position. A first command may be received to move the virtual camera in a first direction. The virtual camera may be translated in the first direction along a surface of the first sphere to a second position. A view of the interior of the 3D room model may be displayed from a second viewpoint of the virtual camera at the second position.

User interface for three-dimensional room modeling

Techniques for placing and manipulating multiple three-dimensional (3D) models using mobile augmented reality (AR) are described. One technique includes receiving a first request to initialize an AR simulation of a first product for sale within a physical environment. In response to the first request, a first 3D model of the first product for sale is rendered onto the screen. After rendering the first 3D model, a second request to visualize a second product for sale within the physical environment is received during the AR simulation of the first product for sale. In response to the second request, a second 3D model of the second product for sale is rendered onto the screen with the first 3D model.

Placing and manipulating multiple three-dimensional (3D) models using mobile augmented reality

A camera is used to capture image data of representations of a physical environment. Planes and surfaces are determined from a representation. The planes and the surfaces are analyzed using relationships there between to obtain shapes and depth information for available spaces within the physical environment. Locations of the camera with respect to the physical environment are determined. The shapes and the depth information are analyzed using a trained neural network to determine items fitting the available spaces. A live camera view is overlaid with a selection from the items to provide an augmented reality (AR) view of the physical environment from an individual location of the locations. The AR view is enabled so that a user can port to a different location than the individual location by an input received to the AR view while the selection from the items remains anchored to the individual location.

Curated environments for augmented reality applications

A system and method for fitting virtual eyewear models on face models is described herein. The method includes attaching a first collider to a model of eyewear and attaching a second collider to a model of a user's face. The method also includes positioning the model of eyewear onto the model of the user's face by reducing a distance between the model of eyewear and the model of the user's face until the first collider attached to the model of eyewear collides with the second collider attached to the model of the user's face and anchoring the model of eyewear to the model of the user's face.

Fitting virtual eyewear models on face models

Devices, systems, and methods are provided for real-time object placement guidance in augmented reality experience. An example method may include receiving, by a device having a sensor, an indication of an object to be viewed in an physical environment of the device. The example method may also include determining a 3D model of the physical environment using data of the physical environment captured by the sensor. The example method may also include determining that a first surface in the 3D model of the environment is a first floor space, and a second surface in the 3D model of the environment is a first wall space. The example method may also include determining that a portion of the first surface is unoccupied and sized to fit the object. The example method may also include determining a first location in the 3D model of the physical environment for placement of a virtual representation of the object based on a 3D model of the object, wherein the first location corresponds to the portion of the first floor space. The example method may also include generating the virtual representation of the object for display at the first location, the virtual representation of the object having a first orientation, wherein the first orientation is based on a second orientation of the second surface. The example method may also include generating a first real-time view of the physical environment comprising the virtual representation of the object within the portion of the first location and in the first orientation. In some cases, a real-time virtual overlay may also be generated in the physical environment, the real-time virtual overlay indicating a location of a floor space in the physical environment.

Systems and methods for real-time object placement in augmented reality experience

Systems and methods for displaying digital objects in multiple configurations based on a placement location within an Augmented Reality (AR) display. The systems are enabled to receive image data, identify multiple horizontal surfaces within the image data, and place a digital object model within the image data. The digital object model is placed in the AR display in a first configuration when placed with an anchor of the digital object model on a first horizontal surface and in a second configuration when placed with the anchor on a second horizontal surface.

Augmented reality object model configuration based on placement location

Approaches in accordance with various embodiments provide for the presentation of augmented reality (AR) content with respect to optically challenging surfaces. Such surfaces can be difficult to locate using conventional optical-based approaches that rely on visible features. Embodiments can utilize the fact that horizontal surfaces can be located relatively easily, and can determine intersections or boundaries of those horizontal surfaces that likely indicate the presence of another surface, such as a vertical wall. This boundary can be determined automatically, through user input, or using a combination of such approaches. Once such an intersection is located, a virtual plane can be determined whose relative location to a device displaying AR content can be tracked and used as a reference for displaying AR content.

Optically challenging surface detection for augmented reality

A complex three-dimensional virtual representation of an object can be rendered. Virtual images can be captured representing a plurality of views of the complex virtual representation. The virtual images can be converted into binary masks depicting the object pixels and non-object pixels in the virtual images. The binary masks can be used to create a three-dimensional representation of the object having lower complexity than the first three-dimensional virtual representation of the object. In embodiments, the low complexity three-dimensional virtual representation of the object and the virtual images are sent to a mobile device to render a low payload representation of the object on the mobile device.

Rendering three-dimensional models on mobile devices

Growing community of inventors

Santa Clara, CA, United States of America

Xing Zhang