A9.com, Inc.

Grabango Co.

Scott Paul Robertson

Arnab Sanat Kumar Dhua

David Creighton Mott

William Brendel

Nityananda Jayadevaprakash

Colin Jon Taylor

Kathy Wing Lam Ma

Radek Grzeszczuk

Karl Hillesland

Neil Raj Kumar

Sunil Ramesh

William Glaser

Brian Van Osdol

Daniel Bennett Lythcott-Haims

A system and method for applications of computer vision in linking users with virtual data that can include detecting digital interaction state of a plurality of subjects in an environment using at least one sensor-based monitoring system; detecting a contextual organization of subjects relative to an operator station; at the operator station, augmenting the user interface based on the contextual organization of subjects which comprises of at least: presenting a set of subject indicators in the user interface with the subject indicators arranged in response to contextual organization, and in response to received user interaction with at least one selected subject indicator, accessing the digital interaction state of the subject associated the at least one subject indicator.

Cashier interface for linking customers to virtual data

Objects can be rendered in three dimensions and viewed and manipulated in an augmented reality environment. A number of object images, a number of segmentation masks, and an object mesh structure are used by a client device to render the object in three dimensions. The object images and segmentation masks can be sequenced into frames. The object images and segmentation masks can be partitioned into patches and sequenced, or ordered, within each patch, and a keyframe can be assigned in each patch. Then, the object images and segmentation masks can be encoded into video files and sent to a client device. The client device can quickly retrieve a requested object image and segmentation mask based at least in part on identifying the keyframe in the same patch as the object image and segmentation mask.

Compression of multi-dimensional object representations

Various embodiments provide methods and systems for users and business owners to share content and/or links to visual elements of a place at a physical location, and, in response to a user device pointing at a tagged place, causing the content and/or links to the visual elements of the place to be presented on the user device. In some embodiments, content and links are tied to specific objects at a place based at least in part upon one of Global Positioning System (GPS) locations, Inertial Measurement Unit (IMU) orientations, compass data, or one or more visual matching algorithms. Once the content and links are attached to the specific objects of the place, they can be discovered by a user with a portable device pointing at the specific objects in the real world.

Sharing links in an augmented reality environment

Systems and methods for displaying an image of a virtual object in an environment are described. A computing device is used to capture an image of a real environment including a marker. One or more virtual objects which do not exist in the real environment are displayed in the image based at least on the marker. The distance and orientation of the marker may be taken into account to properly size and place the virtual object in the image. Further, virtual lighting may be added to an image to indicate to a user how the virtual object would appear with the virtual lighting.

Improving advertisement relevance

Approaches enable images submitted by users, owner, and/or authorized person of a point of interest (e.g., a place, a scene, an object, etc.) to be used as a fiducial to assist recognition and tracking of the point of interest in an augmented reality environment. Multiple images (e.g., crowd-sourced images) of a point of interest taken from different points of view can be dynamically used. For example, as a user with a user device moves through a point of interest, a different image can be chosen from a set of stored candidate images of the point of interest based at least upon GPS locations, IMU orientations, or compass data of the user device. In this way, instead of relying on artificial fiducial images for various detection and tracking approaches, approaches enable images submitted by users and/or an owner or other authorized person of a point of interest to be used as fiducials to assist recognition and tracking of the point of interest.

Adaptive fiducials for image match recognition and tracking

Various embodiments may obtain an image representation of an object for use in image matching and content retrieval. For example, an image matching system processes video content items to determine one or more scenes for one or more video content items. The image matching system can extract, from at least one video frame for a scene, feature descriptors relating to one or more objects represented in the at least one video frame. The image matching system indexes the feature descriptors into a feature index storing information for each of the feature descriptors and respective corresponding video frame. The image matching system correlates the feature descriptors of the feature index to determine one or more groups having similar feature descriptors. The image matching system indexes the one or more groups into a correlation index storing information for each of the one or more groups and respective corresponding feature descriptors.

Growing community of inventors

Mountain View, CA, United States of America

Scott Paul Robertson