Adobe, Inc.

Siddhant Jain

Elya Shechtman

Kalyan Krishna Sunkavalli

Oliver Wang

Gaurush Hiranandani

Kevin Wampler

Kumar Ayush

Chinnaobireddy Varsha

Sai Varun Reddy Maram

Renzil Leith Dsouza

Renzil Leith DSouza

Techniques for incorporating a black-box function into a neural network are described. For example, an image editing function may be the black-box function and may be wrapped into a layer of the neural network. A set of parameters and a source image are provided to the black-box function, and the output image that represents the source image with the set of parameters applied to the source image is output from the black-box function. To address the issue that the black-box function may not be differentiable, a loss optimization may calculate the gradients of the function using, for example, a finite differences calculation, and the gradients are used to train the neural network to ensure the output image is representative of an expected ground truth image.

Incorporating black-box functions in neural networks

Overlay and screen recording techniques are described that enables separate recordings of a screen and one or more overlays that were displayed on the screen during recording. In one example, pixel values of an overlay are blended with pixel values of a screen to paint the overlay onto the screen in a transparent manner that is imperceptible to the human eye but allows for original screen pixel values to be recovered from areas of the screen that were visually occluded by the overlay. This enables a user to display recording controls and visual cues on their screen without having to worry about the overlay visually occluding any screen content during the recording. One or both of the separately recorded screen and overlay streams can then be output for playback to enable viewing of the individual streams without loss in quality or content of the individual streams.

Removing overlays from a screen to separately record screens and overlays in a digital medium environment

Provided are methods and techniques for providing a product recommendation to a user using augmented reality. A product recommendation system determines a user viewpoint, the viewpoint including an augmented product positioned in a camera image of the user's surroundings. Based on the viewpoint, the product recommendation system determines the position of the augmented product in the viewpoint and the similarity between the augmented product and other candidate products that are similar to the augmented product. The product recommendation system then creates a set of recommendation images, each recommendation image including an image of the candidate product that is substituted for the augmented product in the viewpoint. The product recommendation system can then evaluate the recommendation images based on overall color compatibility. Based on the evaluation, for example, the product recommendation system selects a recommendation image that is provided to the user.

Method, medium, and system for product recommendations based on augmented reality viewpoints

Embodiments of the present invention provide systems, methods, and computer storage media directed to operations to facilitate real-time matting using local color estimation and propagation. In accordance with embodiments described herein, an unknown region is estimated based on a set of received boundary points (a zero-level contour that separates the foreground object from the background) and additional contours based on increasing distances from the zero-level contour. The background and foreground colors for each pixel in the unknown region can be estimated and utilized to propagate the foreground and background colors to the appropriate contours in the unknown region. The estimated background and foreground colors may also be utilized to determine the opacity and true background and foreground colors for each pixel in the unknown region which results in an image matted in real-time.

Method and apparatus for real-time matting using local color estimation and propagation

Growing community of inventors

Karnataka, India

Siddhant Jain