A9.com, Inc.

Mark Scott Waldo

Shaun Michael Post

Colin Jon Taylor

Michael Patrick Cutter

Andrea Zehr

Rupa Chaturvedi

Sean Niu

Peiqi Tang

Yu Lou

Stefan Vant

Jared Corso

Jason Canada

Sunil Ramesh

Nicholas Corso

Rahul Bhotika

William Brendel

Ismet Zeki Yalniz

Mark Jay Nitzberg

Chun-Kai Wang

Adam Neustein

Shruti Sheorey

Daniya Zamalieva

Song Cao

Kaolin Imago Fire

Caroline Gehrig

Techniques for providing recommended keywords in response to an image-based query are disclosed herein. In particular, various embodiments utilize an image matching service to identify recommended search keywords associated with image data received from a user. The search keywords can be used to perform a keyword search to identify content associated with an image input that may be relevant. For example, an image search query can be received from a user. The image search query may result in multiple different types of content that are associated with the image. The system may present keywords associated with matching images to allow a user to further refine their search and/or find other related products that may not match with the particular image. This enables users to quickly refine a search using keywords that may be difficult to identify otherwise and to find the most relevant content for the user.

Methods to present search keywords for image-based queries

Users can view images or renderings of items placed (virtually) within a physical space. For example, a rendering of an item can be placed within a live camera view of the physical space. A snapshot of the physical space can be captured and the snapshot can be customized, shared, etc. The renderings can be represented as two-dimensional images, e.g., virtual stickers or three-dimensional models of the items. Users can have the ability to view different renderings, move those items around, and develop views of the physical space that may be desirable. The renderings can link to products offered through an electronic marketplace and those products can be consumed. Further, collaborative design is enabled through modeling the physical space and enabling users to view and move around the renderings in a virtual view of the physical space.

Object preview in a mixed reality environment

Various embodiments provide techniques for generating a virtual wardrobe in which wearing of items can be tracked through computer vision. In various embodiments, computer vision techniques can be used to identify individual clothing items from an image or video of a closet containing a collection of clothes, in which some of the items may be partially obscured, such as positioned behind other items, folded, at an odd viewing angle, shadowed, or the like. Through the present techniques, the clothing items may be automatically cataloged, and utilization of individual items can be tracked automatically based on additional image data of instances in which an item is worn. Various recommendations can then be made based on the attributes of the items in the virtual wardrobe or utilization of the items.

Computer vision based tracking of item utilization

Various embodiments of the present disclosure provide systems and method for visual search and augmented reality, in which an onscreen body of visual markers overlayed on the interface signals the current state of an image recognition process. Specifically, the body of visual markers may take on a plurality of behaviors, in which a particular behavior is indicative of a particular state. Thus, the user can tell what the current state of the scanning process is by the behavior of the body of visual markers. The behavior of the body of visual markers may also indicate to the user recommended actions that can be taken to improve the scanning condition or otherwise facilitate the process. In various embodiments, as the scanning process goes from one state to another state, the onscreen body of visual markers may move or seamlessly transition from one behavior to another behavior, accordingly.

Visual feedback of process state

Systems and methods for a markerless approach to displaying an image of a virtual object in an environment are described. A computing device is used to capture an image of a real-world environment; for example including a feature-rich planar surface. One or more virtual objects which do not exist in the real-world environment are displayed in the image, such as by being positioned in a manner that they appear to be resting on the planar surface, based at least on a sensor bias value and scale information obtained by capturing multiple image views of the real-world environment.

Markerless image analysis for augmented reality

A music playlist may be generated based on images selected by a user on a computing device. For example, by using image classification and machine learning, image descriptors may automatically be associated with an image and the assigned image descriptors mapped to music descriptors associated with songs. Songs associated with the mapped music descriptors are identified and assembled in a playlist sent to the user's device. Additional images may be identified, for example based on the image descriptors of the selected images and the music descriptors, to identify images to display during playback of the playlist.

Image recognition and classification techniques for selecting image and audio data

An auxiliary device can be used to display a fiducial that contains information useful in determining the physical size of the fiducial as displayed on the auxiliary device. A primary device can capture image data including a representation of the fiducial. The scale and orientation of the fiducial can be determined, such that a graphical overlay can be generated of an item of interest that corresponds to that scale and orientation. The overlay can then be displayed along with the captured image data, in order to provide an augmented reality experience wherein the image displayed on the primary device represents a scale-appropriate view of the item in a location of interest corresponding to the location of the auxiliary device. As the primary device is moved and the viewpoint of the camera changes, changes in relative scale and orientation to the fiducial are determined and the overlay is updated accordingly.

Auxiliary device as augmented reality platform

Various approaches discussed herein enable providing a virtual reality experience of trying on clothes by augmenting an image of an article of clothing so that it appears to be worn by a particular person who is represented in a separate image. The image of the person wearing a special article of clothing containing a number of gridlines is analyzed along with an image of the special article of clothing as it appears unworn. The analysis includes calculating differences in the images to determine a change in the position of the gridlines between the images, then used to generate body shape data. The body shape data is used to augment an image of a prospective article of clothing, which modified image is then combined with the image of the person wearing a special article of clothing and displayed.

Augmented reality fitting approach

Growing community of inventors

Richmond, CA, United States of America

Mark Scott Waldo