Shiseido Company, Limited

Kai Ho Edgar Cheung

Yun Fu

Bin Sun

Shuyang Wang

Sumin Lee

Shuhui Jiang

Aneesh Bhat

A method for image transformation including receiving, from an electronic device, an input image having represented therein an object having a predefined region with a selected characteristic, extracting, from the input image, an isolated image corresponding to the predefined region, inputting the isolated image into a baseline generator, trained by an offline unbalanced neural network, that generates a new image that represents a modification to the predefined region in which the selected characteristic is replaced with a baseline characteristic, and generating an output image that reflects a modification of the input image to include a representation of the new image.

System and method for image transformation

The present disclosure provides systems and methods for virtual facial makeup simulation through virtual makeup removal and virtual makeup add-ons, virtual end effects and simulated textures. In one aspect, the present disclosure provides a method for virtually removing facial makeup, the method comprising providing a facial image of a user with makeups being applied thereto, locating facial landmarks from the facial image of the user in one or more regions, decomposing some regions into first channels which are fed to histogram matching to obtain a first image without makeup in that region and transferring other regions into color channels which are fed into histogram matching under different lighting conditions to obtain a second image without makeup in that region, and combining the images to form a resultant image with makeups removed in the facial regions. The disclosure also provides systems and methods for virtually generating output effects on an input image having a face, for creating dynamic texturing to a lip region of a facial image, for a virtual eye makeup add-on that may include multiple layers, a makeup recommendation system based on a trained neural network model, a method for providing a virtual makeup tutorial, a method for fast facial detection and landmark tracking which may also reduce lag associated with fast movement and to reduce shaking from lack of movement, a method of adjusting brightness and of calibrating a color and a method for advanced landmark location and feature detection using a Gaussian mixture model.

Systems and methods for virtual facial makeup removal and simulation, fast facial detection and landmark tracking, reduction in input video lag and shaking, and method for recommending makeup

Growing community of inventors

Jamaica Plain, MA, United States of America

Kai Ho Edgar Cheung