Magic Leap, Inc.

Symbol Technologies, LLC

Zhiheng Jia

Hao Zheng

Jeremy A Grata

Etienne Gregoire Grossmann

Jeffrey Todd Daiker

Lionel Ernest Edwin

Ivan Li Chuen Yeoh

Adam Charles Carlson

Grace Vesom

Robert Dale Tekolste

David S Koch

Daniel Roger Dominguez

Frederick Dennis Zyda

Jeffrey Steven Kranski

Grace Shin-Yee Tsai

Li Jiang

Hans Brandon Wach

Eric C Browy

Jason A Schaefer

Miller Harry Schuck, Iii

Marshall Charles Capps

John Monos

Lei Zhang

Kazunori Tanaka

Nukul Sanjay Shah

Xiao Li

Nicholas Ihle Morley

Timothy Alan Ellis

Michael Alexander Sours

Joseph W Weber

Ohad Zohar

Robert Zito

Tim Ellis

A head-mounted display system is configured to project light to an eye of a user wearing the head-mounted display system to display content in a vision field of said user. The head-mounted display system comprises at least one diffusive optical element, at least one out-coupling optical element, at least one mask comprising at least one mask opening, at least one illumination in-coupling optical element configured to in-couple light from at least one illumination source into a light-guiding component, an image projector configured to in-couple an image and an at least one illumination source is configured to in-couple light into at least one illumination in-coupling optical element, an eyepiece, a curved light-guiding component, a light-guiding component comprising a portion of a frame, and/or two light-guiding components disposed on opposite sides of at least one out-coupling optical element.

Waveguide-based illumination for head mounted display system

Enhanced eye-tracking techniques for augmented or virtual reality display systems. An example method includes obtaining an image of an eye of a user of a wearable system, the image depicting glints on the eye caused by respective light emitters, wherein the image is a low dynamic range (LDR) image; generating a high dynamic range (HDR) image via computation of a forward pass of a machine learning model using the image; determining location information associated with the glints as depicted in the HDR image, wherein the location information is usable to inform an eye pose of the eye.

Enhanced eye tracking techniques based on neural network analysis of images

Embodiments provide image display systems and methods for a camera calibration using a two-sided diffractive optical element (DOE). More specifically, embodiments are directed to determining intrinsic parameters of a camera using a single image obtained using a two-sided DOE. The two-sided DOE has a first pattern on a first surface and a second pattern on a second surface. Each of the first and second patterns may be formed by repeating sub-patterns that are lined when tiled on each surface. The patterns on the two-sided DOE are formed such that the brightness of the central intensity peak on the image of the image pattern formed by the DOE is reduced to a predetermined amount.

Camera intrinsic calibration

Augmented reality glasses include near eye displays the include sources of imagewise amplitude modulated light optical coupled to spatial phase modulators or active zone plate modulators and optically coupled to eye coupling optics. The sources of imagewise amplitude modulated light can include emissive 2D display panels or light sources coupled to imagewise amplitude modulators. The eye coupling optics can include volume holographic diffraction gratings.

Near eye 3D display with separate phase and amplitude modulators

A method for characterizing a digital color camera includes, for each of three primary colors used in a field sequential color virtual image, determining a conversion model for each color using RGB values and the color-measurement values. For each primary color, the method includes illuminating a display device using an input light beam of a primary color having spectral properties representative of a light beam in a virtual image in a wearable device. The method includes capturing, with the digital color camera, an image of the display device, and determining, from the image, RGB values for each primary color. The method includes capturing, with a color-measurement device, a color-measurement value associated with each corresponding primary color at the display device, thereby acquiring a color-measurement value in an absolute color space. A conversion model for each color is determined using RGB values and the color-measurement values.

Method and system for color calibration of an imaging device

Embodiments provide image display systems and methods for extrinsic calibration of one or more cameras. More specifically, embodiments are directed to camera extrinsic calibration approach based on determining intersection of the rays projecting from the optical centers of the camera and a reference camera. Embodiments determine the relative position and orientation of one or more cameras given image(s) of the same target object from each camera by projecting measured image points into 3D rays in the real world. The extrinsic parameters are found by minimizing the expected 3D intersections of those rays with the known 3D target points.

Camera extrinsic calibration via ray intersections

Embodiments provide image display systems and methods for one or more camera calibration using a two-sided diffractive optical element (DOE). More specifically, embodiments are directed to determining intrinsic parameters of one or more cameras using a single image obtained using a two-sided DOE. The two-sided DOE has a first pattern on a first surface and a second pattern on a second surface. Each of the first and second patterns may be formed by repeating sub-patterns that are lined when tiled on each surface. The patterns on the two-sided DOE are formed such that the brightness of the central intensity peak on the image of the image pattern formed by the DOE is reduced to a predetermined amount.

Techniques for calibrating cameras and displays are disclosed. An image of a target is captured using a camera. The target includes a tessellation having a repeated structure of tiles. The target further includes unique patterns superimposed onto the tessellation. Matrices are formed based on pixel intensities within the captured image. Each of the matrices includes values each corresponding to the pixel intensities within one of the tiles. The matrices are convolved with kernels to generate intensity maps. Each of the kernels is generated based on a corresponding unique pattern of the unique patterns. An extrema value is identified in each of the intensity maps. A location of each of the unique patterns within the image is determined based on the extrema value for each of the intensity maps. A device calibration is performed using the location of each of the unique patterns.

Convolution-based camera and display calibration

An improved method, system, and apparatus is provided to perform camera calibration, where cameras are mounted onto a moving conveyance apparatus to capture images of a multi-planar calibration target. The calibration process is optimized by reducing the number of images captured while simultaneously preserving overall information density.

Camera calibration system, target, and process

Multiple cameras are coupled to a camera rig. Multiple diffractive optical elements (DOEs) are coupled to a DOE prop. Each camera is positioned in an eye box of a DOE and takes an image when the cameras are positioned at a first position, a second position and a third position relative to the DOEs. Three images taken by a each camera at each one of the first position, the second position and third position. The images are transmitted to a processor coupled to the camera rig. For each image, the processor identifies data pairs, each data pair including pixel coordinates of an intensity peak in the image and virtual light source produced by the diffractive optical element that corresponds to the intensity peak, and determines extrinsic parameters of the cameras using the identified data pairs for each image.

System and methods for extrinsic calibration of cameras and diffractive optical elements

Embodiments provide a camera design (e.g., an eyeball camera) that mimics a human eye in geometry, optical performance and/or motion. The eyeball camera adopts the same cornea and pupil geometry from the human eye, and has the iris and pupil configured with multiple texture, color or diameter options. The resolution of the eyeball camera is designed to match the acuity of typical 20/20 human vision, and focus is adjusted from 0 to 4 diopters. A pair of eyeball cameras are mounted independently on two hexapods to simulate the human eye gaze and vergence. The perceived virtual and real world are calibrated and evaluated based on eye conditions like pupil location and gaze using the eyeball cameras. The eyeball camera serves as a bridge to combine the data from spatial computing like eye tracking, 3D geometry of the digital world, display color accuracy/uniformity, and display optical quality (sharpness, contrast, etc.).

Eyeball camera system and methods for display system calibration

Growing community of inventors

Weston, FL, United States of America

Zhiheng Jia