Facebook Technologies, LLC

Meta Platforms Technologies, LLC

David Vakrat

Vlad Fruchter

Ohad Meitav

Michael Anthony Hall

Shuochen Su

Rajesh Lachhmandas Chhabria

Andrey Tovchigrechko

Monica Stewart

Shengqiong Xie

An electronic device includes one or more processors and memory storing instructions for execution by the one or more processors. The stored instructions include instructions for: receiving infrared image information for a three-dimensional area; receiving non-infrared image information for the same three-dimensional area; performing nonlinear intensity adjustment for the received infrared image information; performing nonlinear intensity adjustment for the received non-infrared image information; blending the intensity-adjusted infrared image information and the intensity-adjusted non-infrared image information to obtain a merged image information; and providing the merged image information for determining a depth map. Also disclosed are a corresponding method performed by the electronic device and a computer readable storage medium storing instructions for execution by one or more processors of an electronic device.

Infrared and non-infrared channel blender for depth mapping using structured light

In one embodiment, a method includes accessing image-sensor data generated by the image sensor, where the image sensor has a color filter array with a pre-determined number of filter sets, and where each set of filters has a single color, splitting the image-sensor data into a pre-determined number of images, where each image corresponds to a portion of the image-sensor data associated with one of the sets of filters, compressing each of the images using an image compression algorithm, and sending the compressed images to a second computing device, where the second computing device is configured to create an output image based on the compressed images.

Image-sensor data compression

A special-purpose hardware device for mitigating motion-to-photon latency in head-mounted displays may include an image signal processor that receives at least one image frame captured by a camera device of a head-mounted-display system. The special-purpose hardware device may also include an input-formatting component that receives the computer-generated imagery. The special-purpose hardware device may further include a blending component that generates at least one mixed-reality frame by overlaying the computer-generated imagery onto the image frame. The special-purpose hardware device may additionally include a frame-output interface that feeds the mixed-reality frame generated by the blending component to a display device of the head-mounted-display system to facilitate displaying the mixed-reality frame for presentation to a user wearing the head-mounted-display system. Various other apparatuses, systems, and methods are also disclosed.

Apparatus, system, and method for mitigating motion-to-photon latency in headmounted displays

A special-purpose hardware device for achieving intraframe image processing in head-mounted displays may include an image-correction component that receives a single image frame destined to be displayed for presentation to a user wearing a head-mounted-display system. The image-correction component may also receive user-motion data indicating that the user wearing the head-mounted-display system has made at least one movement since generation of the single image frame. The image-correction component may further perform hardware-accelerated intraframe processing operations on the single image frame in accordance with the user-motion data to compensate for the movement made by the user on a line-by-line basis. In addition, the special-purpose hardware device may include a frame-output interface that feeds the single image frame to a display device of the head-mounted-display system to facilitate displaying the single image frame for presentation to the user. Various other apparatuses, systems, and methods are also disclosed.

Apparatus, system, and method for mitigating motion-to-photon latency in head-mounted displays

The disclosed special-purpose hardware device may include an image signal processor that receives, from a camera device of a head-mounted-display system, image frames of a physical environment. The special-purpose hardware device may also include a positional tracking component that (1) stores at least a portion of the image frames in a cache of the special-purpose hardware device that has a faster access speed than a main memory of the special-purpose hardware device, (2) tracks, based on the portion of the image frames stored in the cache, a change in the position of the head-mounted display system within the physical environment, and (3) stores the change in the position of the head-mounted-display system in the main memory for use in generating one or more augmented-reality frames. The special-purpose hardware device may further include a frame-output interface that feeds the augmented-reality frames to a display device of the head-mounted-display system.

Growing community of inventors

Sunnyvale, CA, United States of America

David Vakrat