Shopify Inc.

Juho Mikko Haapoja

Daniel Beauchamp

Byron Leonel Delgado

Stephan Leroux

Jonathan Wade

Maas Mansoor Ali Lalani

Franklyn D'Souza

Bryon Leonel Delgado

Franklyn D'souza

Maas Monsoor Ali Lalani

Disclosed herein are methods and systems for building and updating a virtual store based on a physical store. A computing system is structured to receive captured images of a physical space having a set of products. The physical space is simulated by a three-dimensional (3D) model of the physical space. A corresponding representation of the set of products is positioned relative to the 3D model. The computing system is structured to detect, based on the captured images, product information for products in the physical space and generate, based on the product information, an updated representation of the set of products based on the product information. The updated representation of the set of products corresponds to the products in the physical space as shown in the captured images.

Build and update a virtual store based on a physical store

Systems and methods for generating AR content to virtually alter a real-world item are provided. The real-world item may be a deformable item including one or more flexible surfaces. According to an embodiment, a method includes determining the relative positions of a plurality of points on the real-world item. Based on the relative positions of the plurality of points, a 3D model of a virtual item is distorted to produce a distorted 3D model of the virtual item. The distorted 3D model may have substantially the same shape as the real-world item. AR content is then generated based on the distorted three-dimensional model.

Systems and methods for generating augmented reality content based on distorted three-dimensional models

A merchant may operate a retail store that users are able to visit in person in order to view and purchase products. When a user visits the store, the user might not know where a desired product ('target product') is located. Computer technology may help direct the user to the target product in real-time. In some embodiments, a model of passable areas and the location of products in the retail store may be determined, e.g. by a merchant device. In some embodiments, when the user visits the retail store, a computer generates a product recommendation, e.g. based on user-specific information, and a route in the retail store is determined for the user. In some embodiments, the route in the retail store may be determined using the model based on the target product, the user's location in the store, and one or more recommended products.

Computer-implemented systems and methods for in-store route recommendations

In some embodiments, a computer-implemented system within an e-commerce platform may receive and analyse digital images of scenes in order to generate a recommendation for one or more products offered for sale by a merchant. For example, a user may use their device to capture an image of a room that the user wishes to furnish, and the system may use a trained machine learning algorithm to recommend a product to be placed in the room. The recommended product may be superimposed on the image of the room.

Systems and methods for recommending a product based on an image of a scene

For products that are sold online, the manner in which a product is displayed in an image can affect sales of the product. Embodiments of the present disclosure relate to computer-implemented systems and methods to provide a user with recommendations when generating an image of a product. A method includes obtaining a product image and determining parameters of the product image. A recommendation for modifying the product image is then generated using a model to relate these parameters to market success of the product image. The recommendation is displayed on the user device, and a user can potentially improve subsequent product images by following the recommendation.

Method, system, and non-transitory computer readable medium for providing product image recommendations

Systems and methods are provided for the generation of augmented reality (AR) content that provides a shared AR experience involving multiple users. Shared AR experiences can improve the communication and collaboration between multiple simultaneous users. According to an embodiment, AR content is generated for a first user in a shared AR experience. The AR content includes at least one of a render of a model, a virtual representation of a second user in the shared AR experience, a virtual representation of a user interaction in the shared AR experience, and spatial audio content. Modifications to a shared AR experience are also provided. These modifications may be initiated based on instructions from one user and be reflected in the AR content generated for multiple users.

Systems and methods for representing user interactions in multi-user augmented reality

Generating and storing digital media can be resource intensive processes. Some systems and methods disclosed herein relate to generating digital media using a pre-existing three-dimensional (3D) model of an object and feature points of the object. According to an embodiment, a method includes an e-commerce platform receiving a request for digital media depicting an object. In response to the request, the e-commerce platform may obtain a 3D model corresponding to the object and data pertaining to one or more feature points of the object. The one or more feature points may correspond to respective views of the 3D model. The e-commerce platform may then generate the digital media based on the 3D model and the one or more feature points, where the digital media could include renders of the 3D model depicting the one or more feature points.

Systems and methods for generating digital media based on object feature points

When a person visits a physical retail store, the merchant often does not have enough information about the person to make meaningful product recommendations. Also, a physical retail store typically has products physically distributed throughout the store. It may be desirable to have some sort of relationship between where the customer is and the location of the product being recommended. In some embodiments, when a person visits the store, a computer determines an identity of the person and generates a product recommendation based on user-specific information for that person. In some embodiments, generating the product recommendation includes detecting that a field of view of a camera of the device has changed, and in response determining a plurality of products within or proximate to a current field of view of the camera. At least one of the plurality of products is then identified as the recommended product.

Computer-implemented systems and methods for in-store product recommendations

Systems and methods for generating multi-user augmented reality content

Methods and systems for generating 2D images based on a 3D model are disclosed. 3D three-dimensional (3D) model data associated with a product offering in an online store are sent to a first electronic device, the 3D model data being generated from a stored 3D model. Data representing a selected value for a viewing parameter of the stored 3D model are received from the first electronic device. From the received data, a desired 2D view is determined for a stored 3D model. A recommendation is generated, for a second electronic device, to include the desired 2D view in a stored listing associated with the product offering.

Systems and methods for recommending 2D image

Systems and methods are provided for the generation of augmented reality (AR) scenery for a physical item. The AR scenery allows a customer to interact with the physical item in the real-world, while also allowing the customer to view the physical item in a virtual setting that may be tailored to the customer and/or to the physical item. According to an embodiment, an AR scene is generated for a physical item. The AR scene includes computer-generated scenery and at least a portion of an image of the physical item, where the computer-generated scenery is based on information associated with the user and/or the physical item. The AR scene is then displayed on a device.

Growing community of inventors

Toronto, Canada

Juho Mikko Haapoja