Facebook, Inc.

Houman Meshkin

Ficus Kirkpatrick

William Samuel Bailey

Hermes Germi Pique Corchs

Ryan Keenan Olson

Bruno Pereira Evangelista

Catherine Yoo

Anaelisa Aburto

David Michael Garrison Hill

Chayan Goswami

Sung Kyu Robin Kim

Ben Max Rubinstein

Ian Heisters

Helen Haekwang Kim

Ernest Rowe

In one embodiment, a method includes a system accessing an image, which may comprise covered and uncovered portions, and an overlay image comprising opaque pixels. The covered portion may be configured to be covered by the opaque pixels of the overlay image. The system may generate a data structure comprising data elements associated with pixels of the image. Each of the data elements associated with a covered pixel in the covered portion of the image may be configured to identify an uncovered pixel in the uncovered portion of the image that is closest to the covered pixel. Each covered pixel in the covered portion of the image may be modified by accessing the data element associated with the covered pixel, determining a distance between the covered pixel and an associated closest uncovered pixel using the accessed data element, and modifying a color of the covered pixel based on the distance.

Systems and methods for occluding images and videos subject to augmented-reality effects

Methods, systems, and non-transitory computer readable storage media are disclosed for rendering makeup products on a user's face within an augmented reality environment in real-time. For example, the disclosed system can use blend a base makeup color of a selected makeup product with extracted luminance frequencies of a video stream. The disclosed system can then convert the blended makeup color to LAB color space and apply one or more shader models to the lightness of the color based on a material of the selected makeup product. The disclosed system can also apply additional operations for smoothing the skin of the user and matching the makeup product to a skin tone of the user. The disclosed system can then display the makeup product and any additional changes in an augmented reality environment in the video stream.

Generating realistic makeup in a digital video stream

Growing community of inventors

El Cerrito, CA, United States of America

Houman Meshkin