Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Romain Bachy

Edward Buckley

Thomas Scott Murdison

Jasmine Soria Sears

Kevin James MacKenzie

Nathan Seigo Matsuda

Charlene Mary Atlas

Ocean Quigley

Sapna A Shroff

Barry David Silverstein

Bo Zhang

Jiangtao Kuang

Honghong Peng

Anjul Patney

Todd Goodall

Trisha Lian

Gizem Rufo

An example method is provided for applying a virtual lighting effect to virtual content based on ambient light associated with a real-world scene. The example method includes obtaining a measurement of ambient light associated with a scene of a real-world environment. The example method includes applying a virtual lighting effect to virtual content based at least in part on the measurement of the ambient light. And the example method includes causing display of the virtual content with the applied virtual lighting effect on a display of a computing device for displaying augmented reality, wherein the scene of the real-world environment is visible through the display.

Techniques for adaptively rendering virtual content n artificial reality environments based on ambient lighting of a real-world scene

In one embodiment, a computing device may determine a virtual content to be displayed with a scene of a real-world environment. The device may generate an image depicting the virtual content. Using one or more sensors, the device may detect characteristics of the scene of the real-world environment. Based on the image and the characteristics of the scene, the device may determine that a visual enhancement is to be applied to the virtual content depicted in the image to enhance a contrast between the depicted virtual content and the scene. The device may generate a visually-enhanced image depicting the virtual content by applying the visual enhancement to the virtual content depicted in the image. The device may display the visually-enhanced image of the virtual content on a display of the computing device, wherein the scene of the real-world environment is visible through the display.

Adaptive rendering in artificial reality environments

In one embodiment, a computing system may determine, a predicted eye position of a viewer corresponding to a future time moment for displaying a frame. The system may generate a first correction map for the frame based on the predicted eye position of the viewer. The system may retrieve one or more second correction maps used for correcting one or more proceeding frames. The system may generate a third correction map based on the first correction map generated based on the predicted eye position of the viewer and the one or more second correction maps used for correcting the one or more proceeding frames. The system may adjust pixel values of the frame based at least on the third correction map. The system may output the frame with the adjusted pixel values to a display.

Dynamic uniformity correction

A display assembly generates environmentally matched virtual content for an electronic display. The display assembly includes a display controller and a display. The display controller is configured to estimate environmental matching information for a target area within a local area based in part on light information received from a light sensor. The target area is a region for placement of a virtual object. The light information describes light values. The display controller generates display instructions for the target area based in part on a human vision model, the estimated environmental matching information, and rendering information associated with the virtual object. The display is configured to present the virtual object as part of artificial reality content in accordance with the display instructions. The color and brightness of the virtual object is environmentally matched to the portion of the local area surrounding the target area.

Display that uses a light sensor to generate environmentally matched artificial reality content

Adjusted overlaid images are generated in response to at least one color reference object or color reference point. A display is driven to present the adjusted overlaid image.

Adjusted overlaid images in scenes

In one embodiment, a computing system may determine, for a current frame to be displayed and using an eye tracking system, a current eye position of a viewer. The system may determine a first array of scaling factors based on the determined current eye position of the viewer. The system may retrieve one or more second arrays of scaling factors used for correcting one or more proceeding frames of the current frame. The system may determine a third array of scaling factors based on the first array of scaling factors determined based on the current eye position and the one or more second arrays of scaling factors used for correcting the proceeding frames. The system may adjust pixel values of the current frame based at least on the third array of scaling factors. The system may output the current frame with the adjusted pixel values to a display.

In one embodiment, a method includes projecting a source image onto a surface using a lens approximation component, where the surface is associated with sampling points approximating photoreceptors of an eye, where each sampling point has a corresponding photoreceptor type, sampling color information from the projected source image at the sampling points, where the color information sampled at each sampling point depends on the corresponding photoreceptor type, accessing pooling units approximating retinal ganglion cells (RGCs) of the eye, where each pooling unit is associated with groups of one or more of the sampling points, calculating weighted aggregations of the sampled color information associated with the groups of one or more sampling points associated with each pooling unit, and computing a perception profile for the source image based on the weighted aggregations associated with each of the pooling units.

Calibrated sensitivity model approximating the eye

In one embodiment, a computing system may access a dead pixel position corresponding to a dead pixel of a display. The system may access an image and modify the image by applying a mask to a pixel region of the image containing a particular pixel value with a position that corresponds to the dead pixel position. The mask may include an array of first scaling factors for scaling pixels values in the pixel region. The array of first scaling factors may be configured to brighten one or more of the pixel values surrounding the particular pixel value. The system may cause the modified image to be output by the display.

Systems and methods for hiding dead pixels

Adjusted overlaid images are generated in response to at least one color reference object or color reference point.

Color reference for overlaid images

In one embodiment, a computing system may access a dead pixel position corresponding to a dead pixel of a display. The dead pixel may be associated with one of three color channels of the display. The system may access an image and select a set of three masks based on the color channel of the dead pixel. The system may modify the image by applying the set of three masks to a pixel region of the image containing a particular pixel value with a position that corresponds to the dead pixel position. The set of three masks may be respectively applied to three color channels of pixel values in the pixel region of the image. The set of three masks may be configured to minimize an error caused by the dead pixel in an opponent color space. The system may cause the modified image to be output by the display.

Growing community of inventors

Seattle, WA, United States of America

Romain Bachy