Apple Inc.

Siddharth Shankar Hazra

Moinul H Khan

Aleksandr M Movshovich

Anselm Grundhoefer

Ralf Habel

Marwan Hussein

Cheng Kai Chen

Brad W Simeral

Arthur Yasheng Zhang

Enkhamgalan Dorjgotov

Graham Butler Myhre

James E Pedder

Adam S Howell

Yu Horie

Oleg Naroditsky

Igor Stamenov

Nicholas C Soldner

Yohan Rajan

Xiaonan Wen

Victoria C Chan

Tushar Gupta

Yuan Li

Peng Lv

Yanli Zhang

William J Dobbie

Lukas Polok

EnkhAmgalan Dorjgotov

Mehrad Tavakoli

Aleksandar M Movshovich

Performing a combination localization technique includes determining a target localization parameter, selecting a combination localization technique in accordance with the target localization parameter, including a first localization technique associated with a first power error time profile, and a second localization technique associated with a second power error time profile. A device location is determined using the first localization technique for a first time period in accordance with the first power error time profile, and an updated device location is determined using the second localization technique in response to a triggering condition. A further updated device location is determined using the first localization technique following the first time period based on the updated device location. At least one of a combined energy value and a combined maximum error rate for the combination localization technique satisfies the target localization parameter.

Dynamic and intermittent localization

Various implementations track an eye using both camera images and light sensor data, e.g., from a photosensitive surface or set of photodetectors. The camera need not capture images at a high capture rate since the light sensor data captured from the light sensor provides information about the eye during the time periods between camera frames. An eye tracking device may thus provide eye tracking with high temporal resolution using less power and resources and prior devices. The eye tracking device includes a lens (e.g., a diffractive optical element (DOE)) that splits received light onto the camera and light sensor. The camera and light sensor may be aligned, e.g., co-centered. Using such a lens to provide light to an aligned camera and light sensor facilitates tracking the eye characteristics by reducing the need for matching the data and/or accounting for multiple environmental light sources.

Eye tracking based on fusing lens-aligned camera and light sensor data

A method includes obtaining rendered image data that includes a representation of an object for display using a see-through display. The see-through display permits ambient light from a physical environment through the see-through display. The method includes sensing a plurality of light superposition characteristic values associated with the ambient light that quantifies the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on the plurality of light superposition characteristic values and predetermined display characteristics of the representation of the object. The method includes generating, from the rendered image data, display data for the see-through display in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the representation of the object within a performance threshold.

Modifying rendered image data based on ambient light from a physical environment

Various implementations disclosed herein include devices, systems, and methods that dynamically-size zones used in foveated rendering of content that includes text. In some implementations, this involves adjusting the size of a first zone, e.g., a foveated gaze zone (FGZ), based on the apparent size of text from a viewpoint. For example, a FGZ may be increased or decreased in width, height, diameter, or other size attribute based on determining an angle subtended by one or more individual glyphs of the text from the viewpoint. Various implementations disclosed herein include devices, systems, and methods that select a text-rendering algorithm based on a relationship between (a) the rendering resolution of a portion of an image corresponding to a part of a glyph and (b) the size that the part of the glyph will occupy in the image.

Rendering computer-generated reality text

A lens module in a head-mounted device may include a fluid-filled chamber, a semi-rigid lens element that at least partially defines the fluid-filled chamber, and at least one actuator configured to selectively bend the semi-rigid lens element. The semi-rigid lens element may become rigid along a first axis when the lens element is curved along a second axis perpendicular to the first axis. Six actuators that are evenly distributed around the periphery of the semi-rigid lens element may be used to control the curvature of the semi-rigid lens element. The semi-rigid lens element may initially be planar or non-planar. For example, the semi-rigid lens element may initially have a spherically convex surface and a spherically concave surface. A tunable spherical lens may be incorporated into the lens module to offset a parasitic spherical lens power from the semi-rigid lens element.

Electronic device with a tunable lens

Growing community of inventors

Milpitas, CA, United States of America

Siddharth Shankar Hazra