Meta Platforms Technologies, LLC

Facebook Technologies, LLC

Meta Platforms, Inc.

Jiangtao Kuang

Sapna A Shroff

Honghong Peng

Edward Buckley

Romain Bachy

Sebastian Sztuk

Zhang Jia

Jun Hu

Yizhi Xiong

Yilei Li

Yuh-Lin Eugene Chang

Zhaonian Zhang

Yazhu Ling

Danni Luo

Hao Xie

Zhenqiang Ying

Robert Phillips, Iii

David Tao

Sung Ho Hong

Demetrios Basil Karanikos

Linsen Bie

A distributed image signal processing (ISP) system for a head-mounted device reduces the power load on the battery of the head-mounted device. The distributed ISP system includes a Bayer image processing engine, an RGB image processing engine, and a YUV image processing engine. The Bayer image processing engine is operated by, for example, processing logic of the head-mounted device. The Bayer image processing engine provides Bayer image data from raw image data. The YUV image processing engine is operated by, for example, processing logic of a (companion) computing device (e.g., a phone, tablet, laptop, compute puck, personal computer). The computing device is communicatively coupled (e.g., wired or wirelessly) to the head-mounted device to receive image data. The RGB image processing engine may be operated by the head-mounted device or the computing device.

Distributed image signal processor (ISP) system for a head-mounted device

A camera system that captures an HDR (High Dynamic Range) image with an improved burst duration time and faster frame rate. The camera system determines a set of different exposure settings for creation of an HDR image. The camera system provides the set of exposure settings to the camera sensor in a series of sequential timing windows. A sensor of the camera system outputs a plurality of stale frames in sequential timing windows for receiving the set of different exposure settings. The plurality of stale frames are followed by a set of image frames in sequential timing windows, with each image captured at a different exposure setting of the set of different exposure settings. The camera system may generate a HDR image using the captured sequence of images.

Exposure bracketed quick burst for low frame rate cameras

A method for using cameras in an augmented reality headset is provided. The method includes receiving a signal from a sensor mounted on a headset worn by a user, the signal being indicative of a user intention for capturing an image. The method also includes identifying the user intention for capturing the image, based on a model to classify the signal from the sensor according to the user intention, selecting a first image capturing device in the headset based on a specification of the first image capturing device and the user intention for capturing the image, and capturing the image with the first image capturing device. An augmented reality headset, a memory storing instructions, and a processor to execute the instructions to cause the augmented reality headset as above are also provided.

Camera control using system sensor data

Video presence systems are described that detect an area of interest (e.g., facial region) within captured image data and analyze the area of interest using known color information of the content currently being presented by a display, along with measured ambient light color information from a color sensor, to determine whether the area of interest (e.g., face) is currently illuminated by the display or whether the AOI is not affected by the display and instead only illuminated by the ambient light. Upon determining that the display casts color shade on the AOI, the video presence system pre-processes the image data of the detected area of interest to correct the color back to skin color under ambient light prior to performing general white balance correction.

Color correction for video communications using display content color information

A display assembly generates environmentally matched virtual content for an electronic display. The display assembly includes a display controller and a display. The display controller is configured to estimate environmental matching information for a target area within a local area based in part on light information received from a light sensor. The target area is a region for placement of a virtual object. The light information describes light values. The display controller generates display instructions for the target area based in part on a human vision model, the estimated environmental matching information, and rendering information associated with the virtual object. The display is configured to present the virtual object as part of artificial reality content in accordance with the display instructions. The color and brightness of the virtual object is environmentally matched to the portion of the local area surrounding the target area.

Display that uses a light sensor to generate environmentally matched artificial reality content

Systems and methods for an ambient light sensor (ALS) disposed under a display layer. In some implementations, an ALS reading is adjusted by compensating for light leakage in a display environment. In some aspects, a display leakage component may be determined based on image content driven onto a display pixel array during the ALS reading. An ambient light measurement may be generated by subtracting the display leakage component from the ALS reading and then adjusting a display brightness of the display pixel array in response to the ambient light measurement.

Systems and methods for ambient light sensor disposed under display layer

Growing community of inventors

San Jose, CA, United States of America

Jiangtao Kuang