Adobe Systems Inc.

Adobe, Inc.

Adobeinc.

Abode Systems Incorporated

Jen-Chan Jeff Chien

Hailin Jin

Jue Wang

Xin Lu

Chintan Intwala

Sarah Kong

Shmuel Avidan

Simon Chen

Zhe Lin

Baldo Antonio Faieta

Sylvain Philippe Paris

Zeke Koch

Dennis G Nicholson

Mark M Randall

Dong Feng

Olivier Sirven

Philipp Koch

Scott David Cohen

Gregg Darryl Wilensky

Sunghyun Cho

Yumin Jia

Todor Georgiev Georgiev

Wentian Zhao

Jianming Zhang

Xiaohui Shen

Kevin Gary Smith

Gavin Stuart Peter Miller

Peter Raymond Fransen

Kent Andrew Edmonds

Eric Chan

Vladimir Leonid Bychkovsky

Thomas William Randall Jacobs

Zichuan Liu

Radomir Mech

Brian Lynn Price

Jianchao Yang

Mark C Hamburg

Anant Gilra

Kun Wan

Marc Pawliger

Scott L Byer

Seungyong Lee

Michael W Tao

Yeojin Kim

Jinoh Oh

Haiting Lin

Shitong Wang

He Qin

Hojin Cho

Joseph Ault

Sheng-Wei Huang

Jimei Yang

Daniel Goldman

Alan Lee Erickson

Jovan Popović

Jovan Popovic

Gahye Park

Chenxi Liu

Yu Luo

Xinju Li

Zejun Huang

The present disclosure describes systems, non-transitory computer-readable media, and methods for utilizing a machine learning model trained to determine subtle pose differentiations to analyze a repository of captured digital images of a particular user to automatically capture digital images portraying the user. For example, the disclosed systems can utilize a convolutional neural network to determine a pose/facial expression similarity metric between a sample digital image from a camera viewfinder stream of a client device and one or more previously captured digital images portraying the user. The disclosed systems can determine that the similarity metric satisfies a similarity threshold, and automatically capture a digital image utilizing a camera device of the client device. Thus, the disclosed systems can automatically and efficiently capture digital images, such as selfies, that accurately match previous digital images portraying a variety of unique facial expressions specific to individual users.

Capturing digital images utilizing a machine learning model trained to determine subtle pose differentiations

The present disclosure describes systems, non-transitory computer-readable media, and methods for accurately and efficiently removing objects from digital images taken from a camera viewfinder stream. For example, the disclosed systems access digital images from a camera viewfinder stream in connection with an undesired moving object depicted in the digital images. The disclosed systems generate a temporal window of the digital images concatenated with binary masks indicating the undesired moving object in each digital image. The disclosed systems further utilizes a generator as part of a 3D to 2D generative adversarial neural network in connection with the temporal window to generate a target digital image with the region associated with the undesired moving object in-painted. In at least one embodiment, the disclosed systems provide the target digital image to a camera viewfinder display to show a user how a future digital photograph will look without the undesired moving object.

Automatically removing moving objects from video streams

Embodiments are disclosed for generating lens blur effects. The disclosed systems and methods comprise receiving a request to apply a lens blur effect to an image, the request identifying an input image and a first disparity map, generating a plurality of disparity maps and a plurality of distance maps based on the first disparity map, splatting influences of pixels of the input image using a plurality of reshaped kernel gradients, gathering aggregations of the splatted influences, and determining a lens blur for a first pixel of the input image in an output image based on the gathered aggregations of the splatted influences.

Kernel reshaping-powered splatting-based efficient image space lens blur

Application personalization techniques and systems are described that leverage an embedded machine learning module to preserve a user's privacy while still supporting rich personalization with improved accuracy and efficiency of use of computational resources over conventional techniques and systems. The machine learning module, for instance, may be embedded as part of an application to execute within a context of the application to learn user preferences to train a model using machine learning. This model is then used within the context of execution of the application to personalize the application, such as control access to digital content, make recommendations, control which items of digital marketing content are exposed to a user via the application, and so on.

Application digital content control using an embedded machine learning module

Methods, systems, and non-transitory computer readable media are disclosed for generating artistic images by applying an artistic-effect to one or more frames of a video stream or digital images. In one or more embodiments, the disclosed system captures a video stream utilizing a camera of a computing device. The disclosed system deploys a distilled artistic-effect neural network on the computing device to generate an artistic version of the captured video stream at a first resolution in real time. The disclosed system can provide the artistic video stream for display via the computing device. Based on an indication of a capture event, the disclosed system utilizes the distilled artistic-effect neural network to generate an artistic image at a higher resolution than the artistic video stream. Furthermore, the disclosed system tunes and utilizes an artistic-effect patch generative adversarial neural network to modify parameters for the distilled artistic-effect neural network.

Generating stylized images in real time on mobile devices

The present disclosure relates to systems, methods, and non-transitory computer-readable media that generate refined segmentation masks for digital visual media items. For example, in one or more embodiments, the disclosed systems utilize a segmentation refinement neural network to generate an initial segmentation mask for a digital visual media item. The disclosed systems further utilize the segmentation refinement neural network to generate one or more refined segmentation masks based on uncertainly classified pixels identified from the initial segmentation mask. To illustrate, in some implementations, the disclosed systems utilize the segmentation refinement neural network to redetermine whether a set of uncertain pixels corresponds to one or more objects depicted in the digital visual media item based on low-level (e.g., local) feature values extracted from feature maps generated for the digital visual media item.

Iteratively refining segmentation masks

Utilizing a machine learning model trained to determine subtle pose differentiations to automatically capture digital images

The present disclosure describes systems, non-transitory computer-readable media, and methods for accurately and efficiently removing objects from digital images taken from a camera viewfinder stream. For example, the disclosed systems access digital images from a camera viewfinder stream in connection with an undesired moving object depicted in the digital images. The disclosed systems generate a temporal window of the digital images concatenated with binary masks indicating the undesired moving object in each digital image. The disclosed systems further utilizes a 3D to 2D generator as part of a 3D to 2D generative adversarial neural network in connection with the temporal window to generate a target digital image with the region associated with the undesired moving object in-painted. In at least one embodiment, the disclosed systems provide the target digital image to a camera viewfinder display to show a user how a future digital photograph will look without the undesired moving object.

Digital content control based on shared machine learning properties

Methods and apparatus for retargeting and prioritized interpolation of lens profiles. A lens profile file may include a set of lens sub-profiles. The camera body and/or settings described in the file may not exactly match that of camera body and/or settings used to capture a target image. A sub-profile processing module may perform a prioritized sub-profile sorting and interpolation method to generate an interpolated sub-profile that may be applied to the target image to correct aberrations including, but not limited to, geometric distortion, lateral chromatic aberration, and vignette. Thus, models generated for a reference camera at a variety of settings may be applied to a target image captured with the same type of lens but with a different camera and/or with different settings that are not exactly modeled in the lens profile file.

Methods and apparatus for retargeting and prioritized interpolation of lens profiles

Generating refined segmentation masks based on uncertain pixels

Content creation suggestion techniques are described. In one or more implementations, techniques are implemented to generate suggestions that are usable to guide creative professionals in the creation of content such as images, video, sound, multimedia, and so forth. A variety of techniques are usable to generate suggestions for the content professionals. In a first such example, suggestions are based on shared characteristics of images obtained by users of a content sharing service, e.g., licensed by the users. In another example, suggestions are generated by the content sharing service based on keywords used to locate the images. In a further example, suggestions are generated based on data described communications performed using social network services. In yet another example, recognition of failure of search is used to generate suggestions. A variety of other examples are also contemplated and described herein.

Content creation suggestions using failed searches and uploads

Image cropping suggestion using multiple saliency maps is described. In one or more implementations, component scores, indicative of visual characteristics established for visually-pleasing croppings, are computed for candidate image croppings using multiple different saliency maps. The visual characteristics on which a candidate image cropping is scored may be indicative of its composition quality, an extent to which it preserves content appearing in the scene, and a simplicity of its boundary. Based on the component scores, the croppings may be ranked with regard to each of the visual characteristics. The rankings may be used to cluster the candidate croppings into groups of similar croppings, such that croppings in a group are different by less than a threshold amount and croppings in different groups are different by at least the threshold amount. Based on the clustering, croppings may then be chosen, e.g., to present them to a user for selection.

Image cropping suggestion using multiple saliency maps

Growing community of inventors

Saratoga, CA, United States of America

Jen-Chan Jeff Chien