Adobe, Inc.

Daichi Ito

Byungmoon Kim

Nathan Aaron Carr

Yannick Hold-Geoffroy

Gahye Park

Radomir Mech

Brian Lynn Price

Duygu Ceylan Aksit

Gavin S P Miller

Duygu Ceylan

Long Mai

Tenell Rhodes

Yeojin Kim

Naoto Inoue

Naoki Sasaki

Gavin Stuart Peter Miller

Jose Ignacio Echevarria Vallespi

Zhili Chen

Yijun Li

Cameron Smith

Tsukasa Fukusato

Koki Madono

Embodiments of the present invention provide systems, methods, and non-transitory computer storage media for generating an ambient occlusion (AO) map for a 2D image that can be combined with the 2D image to adjust the contrast of the 2D image based on the geometric information in the 2D image. In embodiments, using a trained neural network, an AO map for a 2D image is automatically generated without any predefined 3D scene information. Optimizing the neural network to generate an estimated AO map for a 2D image requires training, testing, and validating the neural network using a synthetic dataset comprised of pairs of images and ground truth AO maps rendered from 3D scenes. By using an estimated AO map to adjust the contrast of a 2D image, the contrast of the image can be adjusted to make the image appear lifelike by modifying the shadows and shading in the image based on the ambient lighting present in the image.

Methods and systems for geometry-aware image contrast adjustments via image-based ambient occlusion estimation

Systems, methods, and non-transitory computer-readable media are disclosed for modifying voxel-based 3D representations using 3D digital brush tools and/or resolution filters. For example, the disclosed systems can utilize 3D digital brush tools (e.g., a digital blur brush tool, a digital smudge brush tool, and/or a digital melt brush tool) to identify and modify one or more voxels within a 3D representation using multiple buffers of visual properties. Additionally, the disclosed systems can modify one or more voxels within a 3D representation by rendering the one or more voxels at varying levels of detail using an octree (e.g., a mosaic filter tool). In particular, the disclosed systems can identify one or more voxels within an octree that are smaller than a target voxel size. Moreover, the disclosed systems can combine the identified one or more voxels within the octree to render the 3D representation at varying levels of detail.

Modifying voxel resolutions within three-dimensional representations

Methods and systems are provided for a three-dimensional effect on the edge of a multi-page document (e.g., a book). In one embodiment, a first set of image slices associated with a left-eye image is printed on a first side of long pages of a multi-page document. The first set of image slices printed adjacent to edges of the long pages. A second set of image slices associated with a right-eye image is printed on a second side of the long pages of the multi-page document. The second set of image slices printed adjacent to the edges of the long pages. Thereafter, the multi-page document is created by interleaving the long pages with short pages to enable visibility of the first set of image slices and the second set of image slices printed adjacent to the edges of the long pages.

Three-dimensional effect on edge of multi-page document

A vectorized caricature avatar generator receives a user image from which face parameters are generated. Segments of the user image including certain facial features (e.g., hair, facial hair, eyeglasses) are also identified. Segment parameter values are also determined, the segment parameter values being those parameter values from a set of caricature avatars that correspond to the segments of the user image. The face parameter values and the segment parameter values are used to generate a caricature avatar of the user in the user image.

Vectorized caricature avatar generator

Modifying three-dimensional representations using digital brush tools

The present disclosure is directed toward systems and methods that facilitate scanning an object (e.g., a three-dimensional object) having custom mesh lines thereon and generating a three-dimensional mesh of the object. For example, a three-dimensional modeling system receives a scan of the object including depth information and a two-dimensional texture map of the object. The three-dimensional modeling system further generates an edge map for the two-dimensional texture map and modifies the edge map to generate a two-dimensional mesh including edges, vertices, and faces that correspond to the custom mesh lines on the object. Based on the two-dimensional mesh and the depth information from the scan, the three-dimensional modeling system generates a three-dimensional model of the object.

Generating a customized three-dimensional mesh from a scanned object

The present disclosure includes systems, methods, computer readable media, and devices that can generate accurate augmented reality objects based on tracking a writing device in relation to a real-world surface. In particular, the systems and methods described herein can detect an initial location of a writing device, and further track movement of the writing device on a real-world surface based on one or more sensory inputs. For example, disclosed systems and methods can generate an augmented reality object based on pressure detected at a tip of a writing device, based on orientation of the writing device, based on motion detector elements of the writing device (e.g., reflective materials, emitters, or object tracking shapes), and/or optical sensors. The systems and methods further render augmented reality objects within an augmented reality environment that appear on the real-world surface based on tracking the movement of the writing device.

Generating augmented reality objects on real-world surfaces using a digital writing device

Generating a three-dimensional model from a scanned object

Techniques and systems are described to generate a three-dimensional model from two-dimensional images. A plurality of inputs is received, formed through user interaction with a user interface. Each of the plurality of inputs define a respective user-specified point on the object in a respective one of the plurality of images. A plurality of estimated points on the object are generated automatically and without user intervention. Each of the plurality of estimated points corresponds to a respective user-specified point for other ones of the plurality of images. The plurality of estimated points is displayed for the other ones of the plurality of images in the user interface by a computing device. A mesh of the three-dimensional model of the object is generated by the computing device by mapping respective ones of the user-specified points to respective ones of the estimated points in the plurality of images.

3D model generation from 2D images

Generating accurate augmented reality objects in relation to a real-world surface via a digital writing device

A rendering engine is described that implements rendering techniques to render 2D illustrations by assigning light values to objects that define an illustration 'inside out'. Light values may be assigned to a first object and subsequently inherited by objects that are hierarchly related to the first object. The light values assigned to the objects may include a light variable that depends on a relationship between the two or more groups of objects. Various rendering techniques may be employed by the rendering engine to render illustrations that are both customizable and realistic in appearance.

Rendering illustrations using a two-dimensional rendering engine

The present disclosure is directed towards methods and systems for providing a digital mixed output color of two reference colors defined in an RGB model where the digital mixed output color at least generally reflects a color produced by mixing physical pigments of the two reference colors or a custom user-defined color. The systems and methods receive a selection of two reference colors to mix. Additionally, the systems and methods can determine a mixing ratio of the two reference colors. Moreover, the systems and methods query at least one predefined mixing table and identify from the at least one predefined mixing table a mixed output color correlating to a mixture of the two reference colors.

Providing predictable and customizable electronic color mixing

In embodiments of facial feature liquifying using face mesh, an image processing application is implemented to modify facial features of a face in an image from a combination of deformation fields. The image processing application can generate a face mesh that includes landmark points, and then construct the deformation fields on the face mesh, where the deformation fields are defined by warpable elements formed from the landmark points. The image processing application can also combine the deformation fields. The image processing application can also receive an input to initiate modifying one or more of the facial features of the face in the image using the combined deformation fields.

Facial feature liquifying using face mesh

Example systems and methods of providing a user interface are presented. In one example, a graphical object is displayed on an opaque display component on a user-facing side of a computing device. Using a sensing component of the computing device, movement of a physical pointer controlled by a user is sensed. The physical pointer may be located opposite the user-facing side of the computer device. On the opaque display component, a representation of the physical pointer is displayed during the movement of the physical pointer. The graphical object, as displayed on the opaque display component, is modified based on the sensed movement of the physical pointer during the movement of the physical pointer.

Growing community of inventors

Los Gatos, CA, United States of America

Daichi Ito