Meta Platforms, Inc.

Oculus, Vr, LLC

Matthew Robert Fulghum

Evan Mark Richards

Samuel Redmond D'Amico

Simon Hallam

Kieran Tobias Levin

Shizhe Shen

Behnam Bastani

Reza Nourai

Jian Zhang

Xiang Wei

Neel Bedekar

David James Borel

In one embodiment, a method includes receiving a rendered image, motion vector data, and a depth map corresponding to a current frame of a video stream generated by an application, calculating a current three-dimensional position corresponding to the current frame of an object presented in the rendered image using the depth map, calculating a past three-dimensional position of the object corresponding to a past frame using the motion vector data and the depth map, estimating a future three-dimensional position of the object corresponding to a future frame based on the past three-dimensional position and the current three-dimensional position of the object, and generating an extrapolated image corresponding to the future frame by reprojecting the object presented in the rendered image to a future viewpoint associated with the future frame using the future three-dimensional position of the object.

Frame extrapolation with application generated motion vector and depth

Disclosed herein are related to a device and a method of remotely rendering an image. In one approach, a device divides an image of an artificial reality space into a plurality of slices. In one approach, the device encodes a first slice of the plurality of slices. In one approach, the device encodes a portion of a second slice of the plurality of slices, while the device encodes a portion of the first slice. In one approach, the device transmits the encoded first slice of the plurality of slices to a head wearable display. In one approach, the device transmits the encoded second slice of the plurality of slices to the head wearable display, while the device transmits a portion of the encoded first slice to the head wearable display.

Sliced encoding and decoding for remote rendering

Channel selection, quantization, and compression are used to reduce data size of textures used in pixel correction. For example, an apparatus such as a head-mounted display may include circuitry that retrieves a compressed texture from the memory, the compressed texture being generated using various compression techniques, and decompresses the compressed texture to determine adjustment quantization values for sub-pixels based on the compressed values. The circuitry determines reconstructed brightness adjustment levels for the sub-pixels based on the adjustment quantization values, and renders an image frame based on the reconstructed brightness adjustment levels. In some embodiments, the apparatus or a separate device generates the compressed texture in a calibration and stores the texture in a memory of the apparatus for use during the pixel correction.

Display pixel correction using compression

A system for calibrating a liquid crystal display (LCD) includes a plurality of temperature sensors, a storage medium, and a controller. Each temperature sensor measures a current temperature of at least one pixel in the LCD. The storage medium stores information about latencies for any LC-based pixel, wherein each latency corresponds to a time period for transition from a starting to an ending illumination state for one temperature of the LC-based pixel. The controller determines, based on the current temperature, the transition information and frame information, a time for each pixel in at least a portion of the LCD to transition from a first to a second illumination state. The controller computes, based on transition times, an LC transition time for at least the portion of the LCD and performs calibration of at least the portion of the LCD based on the LC transition time.

Display latency calibration for liquid crystal display

A system for calibrating an organic light emitting diode (OLED) display is presented. The calibration system includes a series of photodiodes coupled to at least a portion of illumination elements of the OLED display, a controller, and a driver circuit. The series of photodiodes is configured to measure, for one or more illumination elements, illumination latencies and time delays associated with different brightness levels. The controller obtains, for each illumination element, information about brightness levels associated with image light emitted from that illumination element for at least two consecutive video frames. Based on the measured latencies, the time delays and the information about brightness levels, the controller determines a driving signal for a driver circuit for each illumination element. The driver circuit applies the determined driving signal to that illumination element to calibrate the OLED display.

Display latency calibration for organic light emitting diode (OLED) display

An optical evaluation workstation evaluates quality metrics (e.g., optical contrast) of optical elements of a HMD. The workstation includes a test pattern, an optical element feed assembly, a light source, a camera and a control module. The light source backlights the test pattern with diffuse light. The optical element feed assembly receives an optical element of a HMD and places the optical element at a first distance from the test pattern corresponding to a distance between the optics block in the HMD and an exit pupil of the HMD. The camera images the test pattern through the optical element and the camera is positioned at a second distance from the test pattern corresponding to a distance between the exit pupil and an electronic display in the HMD. The control module generates a test report for presentation to a user based on the evaluation of the optical element.

Viewing optics test subsystem for head mounted displays

An optical evaluation workstation evaluates quality metrics (e.g., virtual image distance) of eyecup assemblies of a head mounted display (HMD). The workstation includes an eyecup assembly feed assembly configured to receive an eyecup assembly of a head mounted display (HMD), the eyecup assembly comprising an optics block rigidly fixed at a first distance to an electronic display panel. The optical evaluation workstation includes a camera assembly configured to capture a plurality of images of the electronic display panel through the optics block, the camera assembly comprising a pinhole aperture at an exit pupil position and a camera attached to a lens assembly having an adjustable focus. The optical evaluation workstation includes a control module configured to determine one or more virtual image distances of the eyecup assembly using the plurality of images captured by the camera assembly.

Virtual image distance test subsystem for eyecup assemblies of head mounted displays

An optical evaluation workstation evaluates quality metrics (e.g., sharpness, blemishes) of eyecup assemblies of a head mounted display (HMD). The workstation includes an eyecup assembly feeder, a camera, and a control module. The eyecup assembly feeder is configured to receive an eyecup assembly of a HMD, the eyecup assembly comprising an optics block rigidly fixed at a first distance to an electronic display panel. The camera is configured to capture one or more images of the one or more test patterns presented by the electronic display panel through the optics block. The control module is configured to modify at least one image of the one or more images using a transform, and determine a quality metric for the modified at least one image.

Growing community of inventors

Palo Alto, CA, United States of America

Matthew Robert Fulghum