Adobe, Inc.

Microsoft Technology Licensing, LLC

New York University

Wilmot Wei-Mau Li

Holger Winnemoeller

Lubomira A Dontcheva

Jun Xie

Aaron Phillip Hertzmann

Jianchao Yang

Jonathan Worthen Brandt

Linjie Luo

Stephen J DiVerdi

Stephen N Schiller

Li-Yi Wei

David Bargeron

Charles Edward Jacobs

David H Salesin

Eric Joel Stollnitz

Daniel Max Kaufman

Kazi Rubaiat Habib

Evan J Schrier

Vidya Narayanan

Amanda Paige Ghassaei

Xiang Yu

Ryo Suzuki

Lubomir D Bourdev

Shmuel Avidan

Michal Lukac

Alan Wilson

Zhicheng Liu

Michal Lukác

Eytan Adar

Ranjitha S Kumar

Suporn Pongnumkul

Hariharan Subramonyam

Matthias Trapp

Adrian Joseph Secord

An object folding tool is leveraged in a digital medium environment. A two-dimensional (2D) representation of an unfolded object is obtained, and visual cues indicating folds for transforming the unfolded object into a folded object are detected. Based on the detected visual cues, a shape of the folded object is determined, and a three-dimensional (3D) representation of the folded object having the determined shape is generated. In one or more implementations, the 2D representation of the unfolded object and the 3D representation of the folded object are displayed concurrently on a display device.

Object folding tool

In implementations of systems for augmented reality sketching, a computing device implements a sketch system to generate three-dimensional scene data describing a three-dimensional representation of a physical environment including a physical object. The sketch system displays a digital video in a user interface that depicts the physical environment and the physical object and the sketch system tracks movements of the physical object depicted in the digital video using two-dimensional coordinates of the user interface. These two-dimensional coordinates are projected into the three-dimensional representation of the physical environment. The sketch system receives a user input connecting a portion of a graphical element in the user interface to the physical object depicted in the digital video. The sketch system displays the portion of the graphical element as moving in the user interface corresponding to the movements of the physical object depicted in the digital video.

Systems for augmented reality sketching

A neighboring panel view is leveraged in a digital medium environment. Initially, a view generation system receives a selection of panels of a three-dimensional (3D) assembled representation of an object, such as to apply digital graphics to the 3D assembled representation. The view generation system also receives a selection of an option to display a neighboring panel view, which is a two-dimensional (2D) flattened view local to the selection. In particular, the neighboring panel view displays an arrangement of the selected panels of the object and their neighboring panels. The view generation system arranges the selected panels in this arrangement as those panels are arranged in the 3D assembled representation. The view generation system also arranges the neighboring panels in the neighboring panel view adjacent to the selected panels with which they are adjacent on the object.

Neighboring panel view

Techniques described herein relate to a streamlined animation production workflow that integrates script drafting, performance, and editing. A script including animation events is parsed to encode the animation events into nodes of a story model. The animation events are automatically triggered by a performance as a playhead advances through the story model and identifies active node(s). A command interface accepts various commands that allow a performer to act as a director by controlling recording and playback. Recording binds a generated animation event to each active node. Playback triggers generated animation events for active nodes. An animated movie is assembled from the generated animation events in the story model. The animated movie can be presented as a live preview to provide feedback to the performer, and a teleprompter interface can guide a performer by presenting and advancing the script to follow the performance.

Animation production system

Enhanced vectorization of raster images is described. An image vectorization module converts a raster image with bitmapped data to a vector image with vector elements based on mathematical formulas. In some embodiments, spatially-localized control of a vectorization operation is provided to a user. First, the user can adjust an intensity of a denoising operation differently at different areas of the raster image. Second, the user can adjust an automated segmentation by causing one segment to be split into two segments along a zone marked with an indicator tool, such as a brush. Third, the user can adjust an automated segmentation by causing two segments to be merged into a combined segment. The computation of the vector elements is based on the adjusted segmentation. In other embodiments, semantic information gleaned from the raster image is incorporated into the vector image to facilitate manipulation, such as joint selection of multiple vector elements.

Enhanced vectorization of raster images

Techniques for interactive scene graph manipulation for visualization authoring are described. In implementations, visual marks are grouped into containers. Each container includes layout settings independent of other containers, and the layout settings are individually adjustable. The visual marks are configured to represent data values. Additionally, the containers are nested in a hierarchy. Then, data visualizations are constructed for display via a user interface of a display device. For example, the data visualizations can be constructed by applying data values to the visual marks and layout settings of the containers to the visual marks grouped within the nested containers to generate the data visualizations.

Interactive scene graph manipulation for visualization authoring

Methods for providing drawing assistance to a user sketching an image include geometrically correcting adjusting user strokes to improve their placement and appearance. In particular, one or more guidance maps indicate where the user 'should' draw lines. As a user draws a stroke, the stroke is geometrically corrected by moving the stroke toward a portion of the guidance maps corresponding to the feature of the image the user is intending to draw based feature labels. To further improve the user drawn lines, parametric adjustments are optionally made to the geometrically-corrected stroke to emphasize 'correctly' drawn lines and de-emphasize &#x201c;incorrectly&#x201d; drawn lines.

Providing drawing assistance using feature detection and semantic labeling

Techniques for facial expression capture for character animation are described. In one or more implementations, facial key points are identified in a series of images. Each image, in the series of images, is normalized from the identified facial key points. Facial features are determined from each of the normalized images. Then a facial expression is classified, based on the determined facial features, for each of the normalized images. In additional implementations, a series of images are captured that include performances of one or more facial expressions. The facial expressions in each image of the series of images are classified by a facial expression classifier. Then the facial expression classifications are used by a character animator system to produce a series of animated images of an animated character that include animated facial expressions that are associated with the facial expression classification of the corresponding image in the series of images.

Facial expression capture for character animation

Various embodiments of a system and methods for using design features to search for page layout designs are described. The document and image structures of a page layout design may be analyzed to determine design features which define the style of the page layout design. Dependent on the design features, style scores may be calculated for the page layout design. Page layout designs may be stored in a database in association with corresponding style scores. A user may indicate a desired page layout style by indicating example page layout designs which exhibit the desired style. Style scores for the example page layout designs may be compared to the style scores for page layout designs stored in the database. Dependent on the comparison, page layout designs stored in the database may be selected and displayed to the user.

System and method for using design features to search for page layout designs

Methods for providing drawing assistance to a user sketching an image include geometrically correcting and parametrically adjusting user strokes to improve their placement and appearance. As a user draws a stroke, the stroke is geometrically corrected by moving the stroke toward a feature of the image the user is intending to draw. To further improve the user strokes, parametric adjustments are made to the geometrically-corrected stroke to emphasize 'correctly' drawn lines and de-emphasize 'incorrectly' drawn lines.

Geometrically and parametrically modifying user input to assist drawing

A plurality of segment transitions in a video data stream is identified. The identifying the plurality of segment transitions includes recognizing an interface feature of a first application interface displayed in the video data stream and generating metadata associating a selected segment transition with a particular point in the video data stream. The interface feature indicates the selected segment transition among the plurality of segment transitions in the video data stream. A navigation system for navigating among the plurality of segment transitions in the video data stream is provided. Responsive to input, navigation to the selected segment transition is performed and the video data stream is displayed from the particular point.

Methods and apparatus for tutorial video enhancement

Growing community of inventors

San Francisco, CA, United States of America

Wilmot Wei-Mau Li