Adobe, Inc.

Xiaozhen Xue

Nicolas Huynh Thien

Akhilesh Kumar

William L Marino

Kshitiz Garg

Daniel Miranda

Brunno Fidel Maciel Attorre

Shabbir Marzban

This disclosure describes one or more implementations of a video inference system that utilizes machine-learning models to efficiently and flexibly process digital videos utilizing various improved video inference architectures. For example, the video inference system provides a framework for improving digital video processing by increasing the efficiency of both central processing units (CPUs) and graphics processing units (GPUs). In one example, the video inference system utilizes a first video inference architecture to reduce the number of computing resources needed to inference digital videos by analyzing multiple digital videos utilizing sets of CPU/GPU containers along with parallel pipeline processing. In a further example, the video inference system utilizes a second video inference architecture that facilitates multiple CPUs to preprocess multiple digital videos in parallel as well as a GPU to continuously, sequentially, and efficiently inference each of the digital videos.

Efficiently inferencing digital videos utilizing machine-learning models

Increasing efficiency of inferencing digital videos utilizing machine-learning models

Disclosed herein are techniques for determining brand safety of a video including image frames and audio content. In some embodiments, frame-level features, scene-level features, and video-level features are extracted by a set of frame-level models, a set of scene-level models, and a set of video-level models, respectively. Outputs from lower level models are used as inputs for higher level models. A brand safety score indicating whether it is safe to associate a brand with the video is determined based on the outputs from the set of video-level models. In some embodiments, commercial content associated with the brand is insert into the video that is determined to be safe for the brand.

Brand safety in video content

Disclosed herein are techniques for digital content integration. A computer-implemented method includes receiving a target digital content item that includes a plurality of frames, identifying a set of candidate host frames for inserting source digital content items from the plurality of frames based on one or more attributes of the target digital content item, determining a candidate score for each respective candidate host frame of the candidate host frames, and generating host time defining data including identifications and the candidate scores of the candidate host frames, where the candidate score indicates a degree of transition of the target digital content item at the candidate host frame. One or more candidate host frames are then selected based on the candidate scores for inserting one or more source digital content items into the target digital content item.

Apparatus, systems, and methods for integrating digital media content

Growing community of inventors

Woodbridge, CT, United States of America

Xiaozhen Xue