A9.com, Inc.

Amazon Technologies, Inc.

Advanced Micro Devices Corporation

Karl Hillesland

Mukul Agarwal

Kevin May

Arnab Sanat Kumar Dhua

Yu Lou

Radek Grzeszczuk

Xing Zhang

Himanshu Arora

Jack Mousseau

Simon Fox

Xi Zhang

Scott Paul Robertson

Asfand Yar Khan

Chun-Kai Wang

Tomas F Yago Vicente

Neil Raj Kumar

Jonathan Bernadel-Huey

Divyansh Agarwal

Kai Chieh Liu

Arnab S Dhua

Jesse Chang

Jason Canada

Nicholas Corso

Justin Hensley

Brian Graham

Devices and techniques are generally described for three dimensional room modeling. In various examples, 3D mesh data representing a room may be received. Plane data comprising a plurality of planes may be received. Each plane of the plurality of planes may represent a planar surface detected in the room. In some cases, a first plurality of wall candidates for a 3D model of the room may be determined based at least in part on the plane data. A second plurality of wall candidates for the 3D model of the room may be determined by modifying the first plurality of wall candidates based on a comparison of the first plurality of wall candidates to the 3D mesh data. The 3D model of the room may be generated based at least in part on the second plurality of wall candidates.

Three-dimensional room modeling

Techniques for placing and manipulating multiple three-dimensional (3D) models using mobile augmented reality (AR) are described. One technique includes receiving a first request to initialize an AR simulation of a first product for sale within a physical environment. In response to the first request, a first 3D model of the first product for sale is rendered onto the screen. After rendering the first 3D model, a second request to visualize a second product for sale within the physical environment is received during the AR simulation of the first product for sale. In response to the second request, a second 3D model of the second product for sale is rendered onto the screen with the first 3D model.

Placing and manipulating multiple three-dimensional (3D) models using mobile augmented reality

Three-dimensional room modeling and feature annotation

Images of various views of objects can be captured. An object mesh structure can be created based at least in part on the object images. The object mesh structure represents the three-dimensional shape of the object. Alpha masks indicating which pixels are associated with the object can be used to refine the object mesh structure. A request can be made to view the object from an arbitrary viewpoint which differs from the viewpoints associated with the captured images. A subset of the captured images can be used to create a synthetic image. Different weights can be assigned to the captured image to render a synthetic image that represents the view from the arbitrary viewpoint selected. The input images for the synthetic image can be prefetched, or loaded into memory before the arbitrary view is requested. The images can also be cached for future use or to avoid reloading them for another synthetic image.

Rendering three-dimensional models on mobile devices

Systems and methods for displaying digital objects in multiple configurations based on a placement location within an Augmented Reality (AR) display. The systems are enabled to receive image data, identify multiple horizontal surfaces within the image data, and place a digital object model within the image data. The digital object model is placed in the AR display in a first configuration when placed with an anchor of the digital object model on a first horizontal surface and in a second configuration when placed with the anchor on a second horizontal surface.

Augmented reality object model configuration based on placement location

Objects can be rendered in three dimensions and viewed and manipulated in an augmented reality environment. A number of object images, a number of segmentation masks, and an object mesh structure are used by a client device to render the object in three dimensions. The object images and segmentation masks can be sequenced into frames. The object images and segmentation masks can be partitioned into patches and sequenced, or ordered, within each patch, and a keyframe can be assigned in each patch. Then, the object images and segmentation masks can be encoded into video files and sent to a client device. The client device can quickly retrieve a requested object image and segmentation mask based at least in part on identifying the keyframe in the same patch as the object image and segmentation mask.

Compression of multi-dimensional object representations

A complex three-dimensional virtual representation of an object can be rendered. Virtual images can be captured representing a plurality of views of the complex virtual representation. The virtual images can be converted into binary masks depicting the object pixels and non-object pixels in the virtual images. The binary masks can be used to create a three-dimensional representation of the object having lower complexity than the first three-dimensional virtual representation of the object. In embodiments, the low complexity three-dimensional virtual representation of the object and the virtual images are sent to a mobile device to render a low payload representation of the object on the mobile device.

A graphics processing unit is configured to map pixels of a first frame of a video stream to texels, select a subset of the texels for shading based on previously cached texels that were shaded for a second frame, and shade the subset of the texels. The graphics processing unit is also configured to cache the shaded subset of the texels with the previously cached texels and determine values for the pixels of the first frame based on the cached texels.

Texel shading in texture space

Embodiments are described for a method for processing textures for a mesh comprising quadrilateral polygons for real-time rendering of an object or model in a graphics processing unit (GPU), comprising associating an independent texture map with each face of the mesh to produce a plurality of face textures, packing the plurality of face textures into a single texture atlas, wherein the atlas is divided into a plurality of blocks based on a resolution of the face textures, adding a border to the texture map for each face comprising additional texels including at least border texels from an adjacent face texture map, and performing linear interpolation of a trilinear filtering operation on the face textures to resolve resolution discrepancies caused when crossing an edge of a polygon.

Implicit texture map parameterization for GPU rendering

Growing community of inventors

San Carlos, CA, United States of America

Karl Hillesland