Comcast Cable Communications, LLC

Future Wei Technologies, Inc.

Vid Scale, Inc.

Interdigital Patent Holdings, Inc.

Other

Alexander Giladi

Dan Grois

Weidong Mao

Xin Ru Wang

Yasser Fouad Syed

Shaobo Zhang

Alex Balk

Xin Liu

Peiyun Di

Yongliang Liu

Yangpo Xu

Jiang Xu

Ali C Begen

Changquan Ai

Christopher Lintz

Blake Orth

Robert Ford

Ali Begen

Methods, systems, and apparatuses are described for encoding video. Video content to be encoded and sent to a computing device may be downscaled into one or more layers. The one or more layers may represent one or more versions of the video content such as one or more versions encoded at different resolutions. The residuals between each layer and the base layer may be upscaled so that one or more parameters associated with optimizing the encoding of the one or more layers may be determined by one or more neural networks based on the downscaling and upscaling process. The residuals between each layer, the one or more parameters, and the base layer may be encoded and sent to a computing device for decoding and playback of the video content using any of the versions of the video content.

Methods, systems, and apparatuses for content-adaptive multi-layer coding based on neural networks

Systems, methods, and apparatuses are described for compressing digital content. The digital content may comprise a plurality of frames. The plurality of frames may comprise a plurality of crossfade frames. A first boundary frame of the crossfade frames may be determined. A second boundary frame of the crossfade frames may be determined. At least a portion of the crossfade frames may be coded as inter-predicted frames using a weighting factor and based on the first boundary frame or the second boundary frame.

Systems and methods for compressing video

A first quantization value for encoding at least one frame of a content item may be determined based at least on a predetermined bitrate and a point in the content item associated with a scene change. A first duration associated with a first portion of the content item may be determined. The first portion of the content item may comprise the at least one frame and may be associated with the first quantization value. A second quantization value for encoding at least another frame of the content item may be determined based at least on the predetermined bitrate. A second duration associated with a second portion of the content item may be determined. The second portion of the content item may comprise the at least another frame and may be associated with the second quantization value.

Processing video using masking windows

Methods, systems, and apparatuses may encode a media content item based on metadata from previous encoding. The encoding may also generate encoding metadata, which may comprise a qualitative or quantitative characterization of the encoded media content item. A prediction engine may, based on this metadata, determine new encoding settings for the same or a different video resolution. The prediction engine may cause an encoded media content item to be stored and may cause encoding of the media content item using the new encoding settings.

Content-aware predictive bitrate ladder

Systems, apparatuses, and methods are described for filtering and/or removing defects from content, such as high dynamic range (HDR) content. A plurality of parameters for filtering one or more pixels may be determined. The parameter(s) may be used to determine one or more filter weights, and the filter weight(s) may be applied to one or more pixels and one or more corresponding prior pixels to generate one or more filtered pixels. The filtered content and/or pixels thereof may later be encoded for storage and/or transmission to users.

Pixel filtering for content

Systems, methods, and apparatuses are described for processing video. A method may comprise receiving video content comprising a plurality of frames and determining a splitting parameter of a partitioning of at least a portion of a first frame of the plurality of frames. Deblock filtering may be implemented on at least the first frame of the plurality of frames based at least on the splitting parameter.

Systems, methods, and apparatuses for processing video

An encoder may determine a plurality of coding units associated with a frame of a media file and a plurality of prediction units associated with the frame of the media file. The encoder may determine, based on the plurality of coding units associated with the frame and the plurality of prediction units associated with the frame, and based on a training of the encoder using one or more neural networks, that a particular region of the frame can be encoded using one or more encoding characteristics that are different than the encoding characteristics of one or more other particular regions of the frame. The encoder may allocate one or more encoding resources to the particular region of the frame based on the one or more encoding characteristics of the particular region of the frame in order to reduce the overall media bitrate.

Processing media using neural networks

Methods and systems are described for managing content. A content asset may be stored as a plurality of content segments. The plurality of content segments may comprise one or more identifiers that may be used to generate a manifest file for playback of the content asset.

Content information for manifest determination

Methods and systems for in-loop filtering may comprise receiving a video comprising at least one frame. The frame may comprise at least one block of pixels. A content complexity of the block of pixels may be determined. A viewing characteristic of the video may be determined. A number of borders to be filtered may be determined based on at least one of the content complexity or the viewing characteristic. A deblocking filter strength may be determined based on at least one of the content complexity or the viewing characteristic. The number of borders of the block of pixels may be filtered according to the deblocking filter strength.

Systems and methods for deblocking filtering

Systems, methods, and devices relating to video encoding for low-concurrency video channels are described herein. A video processing system may receive a manifest request for an encoded video stream associated with a selected channel. Based on the manifest request, the video processing system may request for a real-time linear (RTL) encoder to be started to encode the input compressed video stream for the channel in real-time. Also based on the manifest request, the video processing system may assign a faster-than-real-time (FTRT) encoder from a pool of already-running FTRT encoders to encode the video stream in real-time until the RTL encoder is fully started. The FTRT encoder may encode at a lower quality level to enable expedited real-time encoding. Based on the RTL encoder being fully started, the video processing system may switch the encoding from the FTRT encoder to the RTL encoder. The FTRT encoder may be returned to the FTRT encoder pool.

Video encoding for low-concurrency linear channels

An encoder (e.g., a Versatile Video Coding (VVC) encoder, etc.) may make real-time encoding decisions to vary a bitrate of a content item (e.g., high-resolution video, streaming content, a movie, a show/program, etc.) by upsampling and/or downsampling portions (e.g., frames/slices, group of pictures (GOP), coding units (CU), coding tree units (CTU), etc.) based on a cost function that utilizes a versatile Lagrangian multiplier (denoted as λto denote the versatility). The versatile Lagrangian multiplier may not only account for the effects of quantization (e.g., a quantization parameter (QP), etc.) on portions of the content item, instead, the versatile Lagrangian multiplier may also be based on adjustment parameters associated with content resolution and/or playback quality of experience (QoE). The versatile Lagrangian multiplier enables a substantial decrease in transmission bitrate for portions of a content item without reducing the visual presentation quality and keeping an end-user quality of experience (QoE) at an optimal level.

Method and systems for optimized content encoding

A method for indicating repeat occurrences of advertisements in media content may include one or more of the following. The method may include inserting a first descriptor element for a media content in a media presentation description (MPD) associated with the media content. The method may include inserting a second descriptor element for a repeat occurrence of the media content in the MPD. The second descriptor element may indicate that, during the repeat occurrence of the media content, the media content be presented from the beginning.

Media presentation description

Systems, methods, and apparatuses are described for processing video. Video content comprising a plurality of frames may be received. A visual element of a first frame of the plurality of frames positioned in an oblique direction relative to one or more of a first axis and a second axis orthogonal to the first axis may be determined. One or more regions associated with the first frame and comprising the visual element may be determined. One or more encoded regions of the first frame may be generated based on partitioning the one or more regions comprising the visual element.

A spatial complexity and a temporal complexity associated with one or more frames of media content may be determined. Based on the spatial complexity and the temporal complexity of the media content, a Group of Picture (GOP) size for the one or more frames of the media content may be determined. The GOP size may be inversely proportional to the spatial complexity and the temporal complexity of the one or more frames of media content. Certain frames of the media content may be arranged in a different GOP size as compared to one or more other frames of the media content. By varying the GOP size of the plurality of frames of the media content, the bitrate required to transmit the media content may be decreased without decreasing or substantially decreasing the overall quality of the media content.

Processing media by adaptive group of pictures structuring

Described herein are systems and methods for obfuscating variants of content segments. Variants of content segments can be used to encode an identifying sequence in a transmission of content. The duration parameter of a manifest entry can be modified by a random offset. The data size of variants of a given content segment can be equalized by adding one or more portions of data to one or more of the variants.

Growing community of inventors

Princeton, NJ, United States of America

Alexander Giladi