Adobe, Inc.

Jerry Glen Harris

Sunil Sharadchandra Hadap

Stephen J DiVerdi

Aravind Krishnaswamy

Scott L Byer

John Worthington

Yuyan Song

Stephan D Schaem

Russell T Williams

Walter Michael Shaw

Systems and methods for providing a natural media painting application may receive user inputs through tablet stylus gestures, including gestures that are proximity-based and/or context sensitive. The system may also receive user inputs through the touch of a stylus and/or a user touch on a tablet device. Various digital painting and image editing tasks may be invoked and/or controlled using such inputs in response to detecting and recognizing the stylus gestures. Various gestures defined by a combination of touch and stylus manipulation may be mapped to functions or modes of the application. A touch-and-stylus gesture may be used to invoke a change in the work mode, such as an automatic zoom mode, automatic panning mode, steady detail work mode, or snap to grid mode. A touch-and-stylus gesture may trigger adaptation of one or more parameters of the application to assist a user in performing a detected painting operation in progress.

Methods and apparatus for natural media painting using touch-and-stylus combination gestures

Systems, methods, and computer-readable storage media for performing a visual rewind operation in an image editing application may include capturing, compressing, and storing image data and interaction logs and correlations between them. The stored information may be used in a visual rewind operation, during which a sequence of frames (e.g., an animation) depicting changes in an image during image editing operations is displayed in reverse order. In response to navigating to a point in the animation, data representing the image state at that point may be reconstructed from the stored data and stored as a modified image or a variation thereof. The methods may be employed in an image editing application to provide a partial undo operation, image editing variation previewing, and/or visually-driven editing script creation. The methods may be implemented as stand-alone applications or as program instructions implementing components of a graphics application, executable by a CPU and/or GPU.

System and method for image editing using visual rewind operation

Techniques for natural media painting using proximity-based tablet stylus gestures are described. A stylus is implemented for user manipulation to simulate a brush stroke of a paint brush, where the stylus includes an application tip formed from individual virtual bristles that simulate the paint brush. A graphics application is implemented to receive an input of the brush stroke, compute an effect of each individual virtual bristle of the brush stroke to determine simulated paint application on a virtual canvas, and initiate a display of the simulated paint application on the virtual canvas based on the computed effect of each individual virtual bristle of the brush stroke.

Natural media painting using proximity-based tablet stylus gestures

Systems and methods for providing a natural media painting application may receive user inputs through tablet stylus gestures. A user interface may detect stylus gestures that mimic real-world actions of artists based on information collected during user manipulation of the stylus, and may map the gestures to various digital painting and image editing tasks that may be invoked and/or controlled using the gesture-based inputs. The collected information may include spatial and/or directional information, acceleration data, an initial and/or ending position of the stylus, an initial and/or ending orientation of the stylus, and/or pressure data. The stylus gestures may include translations, rotations, twisting motions, mashing gestures, or jerking motions. The application may perform appropriate painting and image editing actions in response to detecting and recognizing the stylus gestures, and the actions taken may be dependent on the work mode and/or context of the graphics application in which stylus gesture was performed.

Natural media painting using a realistic brush and tablet stylus gestures

The present disclosure includes systems and techniques relating to processing of high resolution images, such as digital painting on high resolution images. In general, one aspect of the subject matter described in this specification can be embodied in a method that includes receiving input defining a modification to a target image; determining, at a first processor, a low resolution proxy result of the modification applied to the target image; determining, at a second processor, a higher resolution result of the modification applied to the target image; displaying the low resolution proxy result before completion of the determining at the second processor; and updating the displayed low resolution proxy result with the higher resolution result. Other embodiments of this aspect include corresponding systems, apparatus, and computer program products.

Progressive refinement of an edited image using secondary high resolution image processing

A method, system, and computer-readable storage medium are disclosed for efficient writing of pixels to tiled planar pixel arrays. An image editing operation is performed by a first thread on an area of an image comprising a plurality of tiles within the area. A lock for write operation is performed by a second thread on each of the plurality of tiles. Results of the lock for write operations are sent from the second thread to the first thread. An output of the image editing operation is sent from the first thread to one or more third thread. The output of the image editing operation is stored in the plurality of tiles by the one or more third threads.

Efficient writing of pixels to tiled planar pixel arrays

A method, system, and computer-readable storage medium are disclosed for conversion of contiguous interleaved image data. Image data in a contiguous interleaved format is received at a graphics processing unit (GPU). The GPU generates converted image data in a tiled format based on the image data in the contiguous interleaved format. The GPU sends the converted image data in the tiled format to a central processing unit (CPU).

Conversion of contiguous interleaved image data for CPU readback

A set of pixels of a background element is identified according to a mask that defines a shape of a foreground element. A color value for a pixel of the foreground element is determined. The determining includes ascertaining a value of a measure of brightness of one or more pixels of a set of pixels of the background element and calculating the color value for the pixel of the foreground element based on the value of the measure of brightness and a value of an adjustable contrast variable. The calculating the color value for the pixel of the foreground element preserves in the foreground element a color component of the one or more pixels of the set of pixels of the background element and increases contrast with the value of the measure of brightness according to the value of the adjustable contrast variable.

Methods and apparatus for improved display of foreground elements

Systems and methods for providing a natural media painting application may receive user inputs through tablet stylus gestures. Various digital painting and image editing tasks may be invoked and/or controlled using such gesture-based inputs. The application may detect stylus gestures that mimic real-world actions of artists, and may perform appropriate painting and image editing actions in response to detecting and recognizing the stylus gestures. The system may provide an automatic zoom mode in which, as the stylus is moved into proximity of the tablet, the application zooms into a displayed image to focus on an area of interest. The system may also provide an automatic panning mode that allows the user to pan an image when the stylus is in proximity to, but not touching, the tablet. One or more thresholds for determining whether the stylus is in proximity with the tablet may be pre-defined or may be user configurable.

Methods and apparatus for natural media painting using proximity-based tablet stylus gestures

Systems, methods, and apparatus for simulating natural media painting in a digital painting application (or painting simulation module) may more accurately simulate real world painting techniques than conventional painting simulation applications. The digital painting application (or simulation module) may provide a small set of physically meaningful parameters (e.g., canvas wetness, drying rate, and pickup mix ratio). By setting the values of these parameters (or overriding default values for a selected paint type), the user may better control the appearance of brush strokes made by a virtual paint brush on a digital canvas. For example, the length of a brush stroke, the amount of streaking caused by paint picked up during the brush stroke, and/or the mix of paint deposited from a pickup buffer and a reservoir buffer of a brush model may be affected by changing the values of these parameters, thus allowing users to create different realistic painting effects.

System and method for simulating paint brush strokes using configurable wetness, drying, and mixing parameters

Methods, systems and computer program products are disclosed for displaying a preview of pixels to be effected by a brush tip area. Input is received for specifying one or more parameters defining a brush tip area. The one or more parameters include a size of the brush tip area. Pixels associated with a canvas in a display window are scanned. The scanned pixels are mapped back into the brush tip area according to a specified transform. A shape of a brush tip taper is calculated to indicate a softness or hardness of an edge of the brush tip area. An output color is composited to the scanned pixels based on the calculated shape of the brush tip taper. A preview representation is displayed of pixels effected by the brush tip area based on the compositing.

Preview representation of pixels effected by a brush tip area

Foreground images, such as cursors, may be displayed over an image by selecting individual pixel colors to contrast with surrounding background pixels. The background pixels in, around and behind the foreground image may be converted from a red-green-blue (RGB) color space to a luminance isolating color space, such as YUV, HSL or the like. The converted pixel information may be copied, stored, or drawn into a separate compositing window. After converting to the luminance isolating color space, the luminance values of the pixels may be adjusted to increase the contrast between the foreground image and the background image. Portions of the foreground image may also be blurred, such as by applying a Gaussian or box blur, such as to soften the edges. The pixel information may then be converted back into the RGB color space and blended with the background information using alpha information for the foreground and background images.

Method and system for dynamic, luminance-based color contrasting in a region of interest in a graphic image

Methods and apparatus, including computer program products, for creating an image-based effect from a digital matte. A digital matte is generated from an image. The digital matte is blurred. The blurred matte is shaped using a predefined shaping transformation. The shaped blurred matte is used to create the effect.

Reducing aliasing artifacts when shaping a digital image

Methods and apparatus for digitally synthesizing non-uniform and seamless images representing textured marks. A method for rendering a mark in a graphics application includes receiving information specifying a mark and generating a representation of the mark based on the received information. The representation includes a sequence of one or more pattern instances. Each pattern instance is selected from a collection of patterns. Each pattern in the collection of patterns includes an arrangement of graphical elements and, furthermore, is selectable while the second component is being generated. The collection of patterns incorporates some variation among the arrangement of graphical elements of the patterns of the collection.

Digitally synthesizing seamless texture having random variations

A method and apparatus, including a computer program apparatus, implementing techniques for reducing aliasing artifacts when shaping a digital image such as a digital matte. Prior to shaping the image, the computer program generates a set of subpixel data values as a function of the pixels of the digital image. Each subpixel data value has an integer component and a fractional component and represents an interpolation between the corresponding pixel and one or more adjacent pixels. After generating the subpixel data values, the computer program maps the subpixel data values to new subpixel data values. The computer program adjusts the original pixel data according to the new subpixel data values, thereby shaping the image. In one configuration, the computer program applies additional lookup tables or image processing operations, such as image shading, directly to the new subpixel data values before updating the pixel data. In this fashion the computer program applies the operation at a higher resolution than if applied directly to the original pixel data, thereby reducing aliasing artifacts that might otherwise be introduced by shaping the digital image.

Growing community of inventors

Newberry, FL, United States of America

Jerry Glen Harris