Shopify Inc.

Jonathan Wade

Juho Mikko Haapoja

Daniel Beauchamp

Franklyn D'Souza

Byron Leonel Delgado

Stephan Leroux

Hettige Ray Perera Jayatunga

Andrew Ngo

Franklyn D'souza

The present disclosure provides image generation systems and methods. The image generation method includes capturing a first 2D image corresponding to a first perspective of a 3D object, and associating the first 2D image with a set of 3D scanning data, the set of 3D scanning data comprising 3D data points corresponding to the first perspective of the 3D object. The method includes obtaining new 3D data points to include in the set of 3D scanning data from a subsequent perspective of the 3D object, the new 3D data points being non-overlapping with 3D data points already in the set of 3D scanning data. The method further includes, responsive to determining that a number of the new 3D data points exceeds a predetermined threshold, automatically capturing a subsequent 2D image corresponding to the subsequent perspective, and associating the subsequent 2D image with the new 3D data points.

Image generation based on tracked 3D scanning

Systems and methods described herein allow a customer to employ AR/VR software to generate virtual representations of physical spaces (e.g., house) and sub-spaces (e.g., living room) to preview virtual objects situated in AR/VR virtual environments. A commerce system (or mobile app associated with the commerce system) may generate virtualized environments representing a physical space (e.g., house, apartment) and regions (e.g., living room, kitchen) based on source images uploaded to or otherwise captured by the commerce system. The end-user may operate the software on a client device and interacts with VR or AR presentations of the virtual environment using a voice-based interface recognized by the software. For example, the end-user may say the name of room (region) or an object and the system retrieves data of the identified room or an appropriate room, such as virtual representations of furniture or objects situated in the room.

Augmented reality enabled dynamic product presentation

Generating and storing product media can be resource intensive processes. Some systems and methods disclosed herein relate to rapidly and/or automatically generating a three-dimensional (3D) composite model to help improve the generation of product media and/or to help reduce product media storage requirements. The 3D composite model may correspond to a product bundle. According to an embodiment, an indication of items associated with a product bundle is obtained. Pre-existing 3D models corresponding to the items are then obtained and used to generate a 3D composite model. The 3D composite model includes representations of the items and may be implemented to provide product media depicting the product bundle.

Systems and methods for generating three-dimensional models corresponding to product bundles

An example process executed by a processor of a computing device to communicate a first light field data to a user device, wherein the first light field data is limited to a first volume of space that represents a first plurality of views for display on the user device; receive a sensor data associated with the user device; predict a behavior based at least in part from the received sensor data; generate a second light field data based at least in part on the predicted behavior, wherein the second light field data is limited to a second volume of space that is different from the first volume of space and represents a second plurality of views for display on the user device; and communicate the second light field data to the user device.

Using prediction information with light fields

The present disclosure provides a system and method for object verification. The method comprises obtaining sensor data, from one or more sensors, the sensor data including measurements of one or more physical properties of a given three-dimensional (3D) object, wherein the sensor data comprises a first measurement of the one or more physical properties from a first perspective and a second measurement of the one or more physical properties from a second perspective, the second perspective being different from the first perspective. The method further comprises comparing the sensor data with reference data, the reference data including measurements of one or more corresponding physical properties of a reference 3D object, and generating, based on the comparing, a verification signal indicating a determined match between the given 3D object and the reference 3D object.

3D object verification system and method

In some embodiments, a computer-implemented system within an e-commerce platform may receive and analyse digital images of scenes in order to generate a recommendation for one or more products offered for sale by a merchant. For example, a user may use their device to capture an image of a room that the user wishes to furnish, and the system may use a trained machine learning algorithm to recommend a product to be placed in the room. The recommended product may be superimposed on the image of the room.

Systems and methods for recommending a product based on an image of a scene

For products that are sold online, the manner in which a product is displayed in an image can affect sales of the product. Embodiments of the present disclosure relate to computer-implemented systems and methods to provide a user with recommendations when generating an image of a product. A method includes obtaining a product image and determining parameters of the product image. A recommendation for modifying the product image is then generated using a model to relate these parameters to market success of the product image. The recommendation is displayed on the user device, and a user can potentially improve subsequent product images by following the recommendation.

Method, system, and non-transitory computer readable medium for providing product image recommendations

Generating and storing digital media can be resource intensive processes. Some systems and methods disclosed herein relate to generating digital media using a pre-existing three-dimensional (3D) model of an object and feature points of the object. According to an embodiment, a method includes an e-commerce platform receiving a request for digital media depicting an object. In response to the request, the e-commerce platform may obtain a 3D model corresponding to the object and data pertaining to one or more feature points of the object. The one or more feature points may correspond to respective views of the 3D model. The e-commerce platform may then generate the digital media based on the 3D model and the one or more feature points, where the digital media could include renders of the 3D model depicting the one or more feature points.

Systems and methods for generating digital media based on object feature points

Methods and systems for generating 2D images based on a 3D model are disclosed. 3D three-dimensional (3D) model data associated with a product offering in an online store are sent to a first electronic device, the 3D model data being generated from a stored 3D model. Data representing a selected value for a viewing parameter of the stored 3D model are received from the first electronic device. From the received data, a desired 2D view is determined for a stored 3D model. A recommendation is generated, for a second electronic device, to include the desired 2D view in a stored listing associated with the product offering.

Systems and methods for recommending 2D image

Systems and methods are provided for the generation of augmented reality (AR) scenery for a physical item. The AR scenery allows a customer to interact with the physical item in the real-world, while also allowing the customer to view the physical item in a virtual setting that may be tailored to the customer and/or to the physical item. According to an embodiment, an AR scene is generated for a physical item. The AR scene includes computer-generated scenery and at least a portion of an image of the physical item, where the computer-generated scenery is based on information associated with the user and/or the physical item. The AR scene is then displayed on a device.

Systems and methods for generating augmented reality scenes for physical items

A computer-implemented method and system may include receiving, from a computing device, a light field data generated by the computing device, the light field data representing a portion of a viewed scene by the user device, wherein the light field data comprises a three-dimensional volume describing the light flowing in a plurality of directions through a plurality of light field data points.

Growing community of inventors

Ottawa, Canada

Jonathan Wade