Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Hauke Malte Strasdat

Richard Andrew Newcombe

Renzo De Nardi

Steven John Lovegrove

Huixuan Tang

Qi Guo

Peter Freese

Jeffrey Scott Campeau

Raycast-based calibration techniques are described for determining calibration parameters associated with components of a head mounted display (HMD) of an augmented reality (AR) system having one or more off-axis reflective combiners. In an example, a system comprises an image capture device and a processor executing a calibration engine. The calibration engine is configured to determine correspondences between target points and camera pixels based on images of the target acquired through an optical system, the optical system including optical surfaces and an optical combiner. Each optical surface is defined by a difference of optical index on opposing sides of the surface. At least one calibration parameter for the optical system is determined by mapping rays from each camera pixel to each target point via raytracing through the optical system, the raytracing being based on the index differences, shapes, and positions of the optical surfaces relative to the one or more cameras.

Raycast calibration for artificial reality head-mounted displays

A calibration system is described that includes a calibration target having one or more calibration objects, a head mounted display (HMD), and a rendering engine configured to render, based on an estimated pose of the HMD, respective virtual calibration objects in a viewing area of the HMD at respective locations corresponding to the one or more calibration objects visible in the viewing area, wherein the HMD is configured to output the virtual calibration targets. The calibration system further includes an image capture system configured to capture image data comprising images of the viewing area of the HMD, and a calibration engine configured to compute, from the image data, difference data comprising respective distances between the one or more calibration objects and the respective, corresponding virtual calibration objects.

End-to-end artificial reality calibration testing

The disclosed computer-implemented method may include directing a head-mounted display system to render, within a frame generated by the head-mounted display system, at least one performance metric for the frame. The method may also include recording when the frame containing the performance metric is displayed by a display of the head-mounted display system, measuring, based at least in part on when the frame containing the performance metric was displayed, at least one aspect of the head-mounted display system's performance, and calibrating the head-mounted display system based on the measurement. Various other methods, calibration systems, and computer-readable media are also disclosed.

Systems and methods for display synchronization in head-mounted display devices

Growing community of inventors

Kirkland, WA, United States of America

Hauke Malte Strasdat