Google Inc.

Qinge Wu

Seth Taylor Raphael

David Chen

Sofien Bouaziz

Mike Xiaoli Ma

Erik Hubert Dolly Goossens

Jonathan James Taylor

Cem Keskin

Nidhi Rathi

Alexander Gregory Chu

Grant Yoshida

Catherine Boulanger

A head-mounted device (HMD) can be configured to determine a request for recognizing at least one content item included within content framed within a display of the HMD. The HMD can be configured to initiate a head-tracking process that maintains a coordinate system with respect to the content, and a pointer-tracking process that tracks a pointer that is visible together with the content within the display. The HMD can be configured to capture a first image of the content and a second image of the content, the second image including the pointer. The HMD can be configured to map a location of the pointer within the second image to a corresponding image location within the first image, using the coordinate system, and provide the at least one content item from the corresponding image location.

Pointer-based content recognition using a head-mounted device

In a general aspect, a head-mounted device (HMD) can be configured to receive a selection of a mode of operation of a content reader of the HMD from a plurality of modes of operation, and initiate, in response to the selection, a content capture process to capture content within a field of view (FOV) of a camera of the HMD. The HMD can be further configured to identify, in the captured content, a plurality of content items, receive a navigation command to select a content item from the plurality of content items, and provide, in response to the navigation command, readback of the selected content item.

Content access and navigation using a head-mounted device

Growing community of inventors

Fremont, CA, United States of America

Qinge Wu