Adobe, Inc.

Daniel M Wilk

David P Simons

James Acquavella

Xue Bai

Jue Wang

David F Herbstman

Scott S Snibbe

Jason T Bartell

One exemplary embodiment involves receiving a plurality of three-dimensional (3D) track points for a plurality of frames of a video, wherein the 3D track points are extracted from a plurality of two-dimensional source points. The embodiment further involves rendering the 3D track points across a plurality of frames of the video on a two-dimensional (2D) display. Additionally, the embodiment involves coloring each of the 3D track points wherein the color of each 3D track point visually distinguishes the 3D track point from a plurality of surrounding 3D track points, and wherein the color of each 3D track point is consistent across the frames of the video. The embodiment also involves sizing each of the 3D track points based on a distance between a camera that captured the video and a location of the 2D source points referenced by the respective one of the 3D track points.

3D tracked point visualization using color and perspective size

One exemplary embodiment involves identifying a plane defined by a plurality of three-dimensional (3D) track points rendered on a two-dimensional (2D) display, wherein the 3D track points are rendered at a plurality of corresponding locations of a video frame. The embodiment also involves displaying a target marker at the plane defined by the 3D track points to allow for visualization of the plane, wherein the target marker is displayed at an angle that corresponds with an angle of the plane. Additionally, the embodiment involves inserting a 3D object at a location in the plane defined by the 3D track points to be embedded into the video frame. The location of the 3D object is based at least in part on the target marker.

Camera tracker target user interface for plane detection and object creation

Systems, methods, and computer-readable storage media for chatter reduction in video object segmentation using a variable bandwidth search region. A variable bandwidth search region generation method may be applied to a uniform search region to generate a variable bandwidth search region that reduces the search range for segmentation methods such as a graph cut method. The method may identify parts of the contour that are moving slowly, and reduce the search region bandwidth in those places to stabilize the segmentation. This method may determine a bandwidth for each of a plurality of local windows of an image according to an estimate of how much an object in the image has moved from a previous image. The method may blend the bandwidths for the plurality of local windows to generate a blended map. The method may then generate a variable bandwidth search region for an object according to the blended map.

Methods and apparatus for chatter reduction in video object segmentation using a variable bandwidth search region

Systems and methods are provided for providing a navigation interface to access or otherwise use image content items. In one embodiment, an image manipulation application identifies at least one offset curve corresponding to at least one base curve. The offset curve may identify an offset curve corresponding to the outer boundary of a feathered region for an image mask. The image manipulation application identifies multiple line segments identifying the offset curve. Each line segment connects a sampled point along the path of the base curve to a corresponding point along the path of the offset curve. The image manipulation application determines that the offset curve includes a retrograde region based on analyzing the line segments. The image manipulation application modifies the at least one offset curve to eliminate at least some of the retrograde region by applying a radius-modulating filter to one or more of the line segments.

Retrograde curve filtering for variable offset curves

Systems and methods for rolling shutter artifact repair are disclosed. For example, one disclosed method includes the steps of receiving two frames (F, F) of a video, identifying a first plurality of features in frame Fand a second plurality of features in frame F, determining movements of corresponding features in the first and second pluralities of features, generating a mesh based on the first and second pluralities of features and the movements, and generating a warped frame (F') based on the mesh

Systems and methods for rolling shutter artifact repair

Systems, methods, and computer-readable storage media for chatter reduction in video object segmentation using optical flow assisted gaussholding. An optical flow assisted gaussholding method may be applied to segmentation masks generated for a video sequence. For each frame of at least some frames in a video sequence, for each of one or more other frames prior to and one or more other frames after the current frame, optical flow is computed for the other frame in relation to the current frame and used to warp the contour of the segmentation mask of the other frame to generate warped segmentation mask for the other frames. The weighted average of the warpedsegmentation masks and the segmentation mask of the current frame is then computed; this weighted average may be blurred spatially, for example using a Gaussian filter. The initial smoothed mask may be thresholded to produce a binary smoothed mask.

Methods and apparatus for chatter reduction in video object segmentation using optical flow assisted gaussholding

Techniques for representing a stroke in an image, the stroke being defined by a path extending across one or more positions in the image and one or more stroke parameters, each stroke parameter representing an appearance attribute of the stroke. The techniques include associating values for the one or more stroke parameters with time values in a time dimension of the stroke, the parameter values being associated with the time values independent of position along the stroke path; and representing the stroke according to the parameter values and their associated time values.

Representing and animating paint strokes

A method of integrating two independent simulations including running a first simulation simulating changes in an object over time. The first simulation includes a first simulation output reflective of a state of the first simulation at one or more predefined times. A second simulation is run concurrently simulating changes in a second object over time. An interaction between the first and second simulations is defined resulting in an integrated simulation output without affecting the first simulation state.

Multi-level simulation

A computer-implemented method for delaying the rendering of source material associated with a source layer in a nested composition that is a layer in a root composition. During the rendering of the root composition the method retrieves the source layer, promotes the source layer to the root layer and delays the rendering of the source material until the root layer is rendered.

Method for concatenated rendering of digital images

A method for compositing first and second digital images having different pixel aspect ratios to reduce distortion of image content. The method includes determining a scaling factor from first and second pixel aspect ratios; scaling a first image by the scaling factor; and compositing the first and second images into a composite image. The scaling step may be limited to stretching or squashing the first image in only a horizontal direction. The scaling step may include resampling the first image. In another aspect, the invention features a method for controlling motion along a motion path in a composition having nonsquare pixels. The method includes determining a scaling factor based on the composition pixel aspect ratio; applying the scaling factor to a copy of the motion path; reparameterizing the copy of the motion path to generate a scaled motion mapping; and using the scaled motion mapping to control motion along the motion path. The motion path may define the motion of a layer in the composition.

Transforming images with different pixel aspect ratios

Data for a temporal sequence of composition frames is created from data of a temporal sequence of footage frames by identifying a set of the footage frames temporally corresponding to a set of the composition frames and blending data from the set of footage frames to create data for the set of composition frames.

Growing community of inventors

Seattle, WA, United States of America

Daniel M Wilk