Adobe, Inc.

Hyunghwan Byun

Sarah Kong

I-Ming Pao

Alan Lee Erickson

Kalyan Krishna Sunkavalli

John W Peterson

Betty Leong

Guotong Feng

Jianming Zhang

Chih-Yao Hsieh

Yinglan Ma

Yukie Takahashi

Frederick Mandia

Meredith Payne Stotzner

Quynn Megan Le

The present disclosure provides systems and methods for image editing. Embodiments of the present disclosure provide an image editing system for perform image object replacement or image region replacement (e.g., an image editing system for replacing an object or region of an image with an object or region from another image). For example, the image editing system may replace a sky portion of an image with a more desirable sky portion from a different replacement image. The original image and the replacement image (e.g., the image including a desirable object or region) include layers of masks. A sky from the replacement image may replace the sky of the image to produce an aesthetically pleasing composite image.

Sky replacement

Systems and methods for image editing are described. Embodiments of the present disclosure provide an image editing system for performing image object replacement or image region replacement (e.g., an image editing system for replacing an object or region of an image with an object or region from another image). For example, the image editing system may replace a sky portion of an image with a more desirable sky portion from a different replacement image. According to some embodiments described herein, thumbnails, region location information, and image metadata from multiple preset images can be stored together and loaded for presentation and selection of a preset image for replacing a region of an image. Once a preset image (e.g., an image with a replacement sky) is selected, a high-resolution version of the image can be loaded and used to generate a composite image.

Sky replacement preset loading

Methods and systems are provided for presenting and using multiple masks based on a segmented image in editing the image. In particular, multiple masks can be presented to a user using a graphical user interface for easy selection and utilization in the editing of an image. The graphical user interface can include a display configured to display an image, a mask zone configured to display segmentations of the image using masks, and an edit zone configured to display edits to the image. Upon receiving segmentation for the image, the masks can be displayed in the mask zone where the masks are based on a selected segmentation detail level.

Presenting multiple image segmentations

This application relates generally to modifying visual data based on audio commands and more specifically, to performing complex operations that modify visual data based on one or more audio commands. In some embodiments, a computer system may receive an audio input and identify an audio command based on the audio input. The audio command may be mapped to one or more operations capable of being performed by a multimedia editing application. The computer system may perform the one or more operations to edit to received multimedia data.

Voice interaction for image editing

Systems and techniques for automatic object replacement in an image include receiving an original image and a preferred image. The original image is automatically segmented into an original image foreground region and an original image object region. The preferred image is automatically segmented into a preferred image foreground region and a preferred image object region. A composite image is automatically composed by replacing the original image object region with the preferred image object region such that the composite image includes the original image foreground region and the preferred image object region. An attribute of the composite image is automatically adjusted.

Automatic object replacement in an image

Techniques are disclosed for deforming an image using Bezier transformation. The image is divided in a plurality of sections. Each section represents a corresponding Bezier patch. Each section comprises a multiple control points for Bezier transformation, with corner control points of the sections forming anchor points. The deformation of the image is performed by selecting multiple anchor points, and interacting with the selected anchor points. A bounding box that includes the selected anchor points is displayed. Translating, rotating, and/or scaling the selected anchor points based on user input relative to the bounding box results in corresponding Bezier transformation of portion of the image within the bounding box. Thus, instead of having to interact with one control point at a time to deform the image, the desired deformation is achieved by selecting multiple anchor points, and applying the Bezier deformation to the whole bounding box defined by the selected anchor points.

Editing bezier patch by selecting multiple anchor points

Methods, systems, and non-transitory computer readable storage media are disclosed for applying piecewise deformations to digital content using a plurality of parametric patches. For example, the disclosed system generates a plurality of parametric patches (e.g., Bezier patches) within a parametric quilt for digital content (e.g., a digital image or digital text). The disclosed system also provides interface controls for user-defined split/patch locations for the parametric quilt. In one or more embodiments, the disclosed system divides digital content into a plurality of portions. The disclosed system modifies one or more parametric patches and deforms a corresponding portion(s) of the digital content based on the modified parametric patch(es). The disclosed system then recombines the portions of the digital content to generate modified digital content that includes any deformations based on the modified parametric patch(es).

Growing community of inventors

Mountain View, CA, United States of America

Hyunghwan Byun