Apple Inc.

Paulo R Jansen Dos Reis

Christopher D Fu

Thomas G Salter

Thomas J Moore

Anshu Kameswar Chimalamarri

Paul Ewers

In Young Yang

Peter Burgner

Ashwin K Vijay

Guilherme Klink

Tigran Khachatryan

Alesha Unpingco

In one implementation, a method of extracting information from a physical environment is performed at a device including an image sensor, one or more processors, and non-transitory memory. The method includes determining a gaze location and a distance to an object in a physical environment at the gaze location. The method includes selecting a field-of-view of the physical environment based on the gaze location and the distance to the object. The method includes obtaining, using the image sensor, an image corresponding to the field-of-view of the physical environment. The method includes extracting information from the image.

Depth-based visual search area

An electronic device may include one or more sensors and one or more displays. The display may be configured to display virtual objects of various types. The electronic device may receive a request to display a first type of virtual object that has a location defined relative to a location corresponding to the electronic device or a user of the electronic device. In response to the request to display the first type of virtual object, the electronic device may determine a depth of an object that is aligned with a target display direction for the virtual object, determine an apparent depth at which to display the virtual object based on at least the depth of the object, and display, via the one or more displays, the virtual object at the apparent depth.

Electronic device that displays virtual objects at different apparent depths

A head-mounted device may be used to perform a visual search on a physical environment around the head-mounted device. A user may wish to visually search one out of multiple physical objects in the physical environment. To clearly show the user which physical object was the target of a visual search, the head-mounted device may present a thumbnail of the candidate physical object on a display. The thumbnail may be cropped and/or zoomed using an image from a camera on the head-mounted device. By displaying a thumbnail that is taken by a camera on the head-mounted device, the thumbnail will directly match the physical object in the user's physical environment, eliminating ambiguity regarding which physical object is the subject of the visual search.

Thumbnail for disambiguation in a visual search

Electronic device that displays virtual objects

Growing community of inventors

San Jose, CA, United States of America

Paulo R Jansen Dos Reis