Magic Leap, Inc.

Zinn Labs, Inc.

Leland Stanford Junior University

Robert Konrad

Gordon Wetzstein

Brian T Schowengerdt

Michael Anthony Klug

Michal Beau Dennison Vaughn

Nitish Padmanaban

Kevin Boyle

Michal Beau Vaughn

An augmented reality display system is configured to direct a plurality of parallactically-disparate intra-pupil images into a viewer's eye. The parallactically-disparate intra-pupil images provide different parallax views of a virtual object, and impinge on the pupil from different angles. In the aggregate, the wavefronts of light forming the images approximate a continuous divergent wavefront and provide selectable accommodation cues for the user, depending on the amount of parallax disparity between the intra-pupil images. The amount of parallax disparity is selected using a light source that outputs light for different images from different locations, with spatial differences in the locations of the light output providing differences in the paths that the light takes to the eye, which in turn provide different amounts of parallax disparity. Advantageously, the wavefront divergence, and the accommodation cue provided to the eye of the user, may be varied by appropriate selection of parallax disparity, which may be set by selecting the amount of spatial separation between the locations of light output.

System and method for presenting image content on multiple depth planes by providing multiple intra-pupil parallax views

A device includes a camera assembly and a controller. The camera assembly is configured to capture images of both eyes of a user. Using the captured images, the controller determines a location for each pupil of each eye of the user. The determined pupil locations and captured images are used to determine eye tracking parameters which are used to compute values of eye tracking functions. With the computed values and a model that maps the eye tracking functions to gaze depths, a gaze depth of the user is determined. An action is performed based on the determined gaze depth.

Determining gaze depth using eye tracking functions

Embodiments are related to a plurality of gaze sensors embedded into a frame of a headset for detection of a gaze vector of a user wearing the headset and user's control at the headset. The gaze vector for an eye of the user can be within a threshold distance from one of the gaze sensors. By monitoring signals detected by the gaze sensors, it can be determined that the gaze vector is within the threshold distance from the gaze sensor. Based on this determination, at least one action associated with the headset is initiated.

Gaze sensors and display elements for detection of gaze vectors and user control at headset

An event camera system for pupil detection may include a camera assembly and a controller, and may also include one or more off-axis light sources. The camera assembly may include one or more infrared (IR) light sources and an event camera. The one or more IR light sources are configured to emit pulses of IR light along an optical path toward an eyebox. The IR light is reflected from an eye in the eyebox, and the reflected light propagates back along the optical path toward the event camera for detection. The controller is configured to determine an orientation of the eye using data output from the event camera.

Event camera system for pupil detection and eye tracking

Near-eye display systems in accordance with embodiments of the invention enable accommodation-invariant display control. One embodiment includes a near-eye display; a processor; a memory containing a target image and an accommodation-invariant display application; where the processor is configured by the accommodation-invariant display application to calculate an impulse response of the near-eye display; calculate a compensation image by generating a deconvolved color channel of the target image using a ratio of the target image and the impulse response, where the compensation image is a representation of the target image that remains in focus at a plurality of distances from the near-eye display; and display the compensation image on the near-eye display.

Growing community of inventors

Palo Alto, CA, United States of America

Robert Konrad