Google Inc.

Sony Corporation

Sony Electronics Inc

Other

Sont Corporation

Marco Paniconi

James J Carrig

Zhourong Miao

Qunshan Gu

Michael Horowitz

Jan K Skoglund

Oguz Demirci

Jing Yang Chen

Ermin Kozica

Mikhal Shemer

Danil Chapovalov

A computer-implemented method includes setting, by a participant computing device participating in a videoconference, a maximum quantization parameter (QP) value for encoding a predetermined type of video frame to a value which is the lesser of: a first QP value determined based on an average value of QP values used to encode video frames before the predetermined type of video frame, or a second QP value corresponding to an application-specified maximum QP value. The computer-implemented method further includes encoding the predetermined type of video frame using the set maximum QP value.

Setting a maximum quantization parameter for encoding a video frame

A computer-implemented method includes setting, by a computing device, a maximum quantization parameter (QP) value for encoding an input video frame to a value which is the maximum of: a first QP value corresponding to a first proportion of an application-specified maximum QP value, or a second QP value determined based on a value which is the minimum of: a third QP value determined based on an average value of QP values used to encode a plurality of video frames before the input video frame, or a fourth QP value corresponding to a second proportion of the application-specified maximum QP value. The computer-implemented method further includes using the set maximum QP value as a quality bound for encoding the input video frame.

Dynamic quantization parameter for encoding a video frame

A method and apparatus for adaptive denoising of source video in a video conference application is provided. Source video frames received from a video capture device are divided into a plurality of 16&#xd7;16 blocks. For each source block, a moving object detection process and a noise estimation process are performed. Then temporal denoising is adaptively applied to the blocks of the source frame based on the noise estimation and moving object detection. The adaptively filtered blocks are provided to an output frame and forwarded to a coding module for encoding.

Real-time adaptive video denoiser with moving object detection

Object-based intra-prediction encoding may include generating, by a processor in response to instructions stored on a non-transitory computer readable medium, an encoded block of a current frame of a video stream by encoding a current block from the current frame, including the encoded block in an output bitstream, and outputting or storing the output bitstream. Encoding the current block may include identifying a first spatial portion of the current block, wherein the first spatial portion includes a first pixel from the current block and omits a second pixel from the current block, encoding the first pixel using a first intra-prediction mode, and encoding the second pixel using a second intra-prediction mode, wherein the second intra-prediction mode differs from the first intra-prediction mode.

Object-based intra-prediction

Encoding is accomplished using a reference picture list. Reference frames are identified with picture numbers and are assigned to reference picture buffers when used for encoding. The picture numbers associated the reference frames in the reference picture buffers are ranked. Reordering can occur to assign short word lengths to those reference frames used frequently for prediction. The resulting encoded reference picture list is sent to a decoder. The decoder decodes the reference picture list. By comparing picture numbers in the reference picture list with picture numbers of reference picture buffers of the decoder, the encoder and decoder buffers can remain in sync even under packet loss conditions. For example, the decoder can use the decoded reference picture list to determine missing and unused reference frames.

Video data encoding using reference picture lists

A method and apparatus for adaptive denoising of source video in a video conference application is provided. Video captured is analyzed on a frame by frame basis to determine whether denoising of the frame should be performed prior to providing the source frame to an encoder. If the frame is to be denoised, the frame is divided into a plurality of blocks and a local denoising process is performed on a block per block basis.

Adaptive denoising for real-time video on mobile devices

Disclosed herein are implementations of systems, methods, and apparatuses for extended protection of digital video streams. The disclosed implementations include a method for transmitting a video stream over a network with forward error correction protection including encoding a current frame of the plurality of frames, producing a plurality of data packets from the encoded frame, generating a plurality of protection packets including data usable for restoring one or more lost data packets of the plurality of data packets, wherein at least one of the plurality of protection packets also includes data usable for restoring a lost protection packet of the protection packets, and wherein a protection packet of the plurality of protection packets includes a packet mask that indicates which of the plurality of data packets and plurality of protection packets are protected by the protection packet, and transmitting the data packets and the protection packets over the network.

Extended protection of digital video streams

Encoding and decoding is accomplished herein using a multi-reference picture buffer. Decoding includes receiving an encoded video stream, determining an expected error value representing possible frame errors, decoding a plurality of reference frames from the video stream, adding each of the plurality of reference frames to the reference picture buffers up to a maximum number of reference picture buffers, and determining an encoded video stream error value representing actual frame errors based on the decoded plurality of reference frames. If the encoded video stream error value is greater than the decoded expected error value, an error is signaled.

Managing multi-reference picture buffers for video data coding

Object-based intra-prediction decoding may include generating a reconstructed block by decoding an encoded block, which may include identifying a first intra-prediction mode for a first portion of the reconstructed block and identifying a second intra-prediction mode for a second portion of the reconstructed block. Decoding the encoded block may include generating a first portion of a prediction block using the first intra-prediction mode, generating a second portion of the prediction block using the second intra-prediction mode, generating the first portion of the reconstructed block based on the first portion of the prediction block, such that the first portion of the reconstructed block corresponds to a first object represented in the reconstructed block, and generating the second portion of the reconstructed block based on the second portion of the prediction block, such that the second portion of the reconstructed block corresponds to a second object represented in the reconstructed block.

Encoding and decoding is accomplished herein using a reference picture list. Reference frames are identified with picture numbers and are assigned to reference picture buffers when used for encoding. The picture numbers associated the reference frames in the reference picture buffers are ranked. Reordering can occur to assign short word lengths to those reference frames used frequently for prediction. The resulting encoded reference picture list is sent to a decoder. The decoder decodes the reference picture list. By comparing picture numbers in the reference picture list with picture numbers of reference picture buffers of the decoder, the encoder and decoder buffers can remain in sync even under packet loss conditions. For example, the decoder can use the decoded reference picture list to determine missing and unused reference frames.

Video data encoding and decoding using reference picture lists

A method for decoding a packetized video signal including at least one encoded frame. In one case, the method includes receiving at least one FEC packet at a receiving station. The receiving station uses embedded data associated with the FEC packet to obtain more accurate knowledge of the packet loss state of the media packets. This improved knowledge can allow the receiver to make better use of packet retransmission requests. The embedded data associated with the FEC packet can include in some cases a base sequence number and a packet mask.

Method and apparatus for decoding packetized data

Encoding and decoding is accomplished herein using a multi-reference picture buffer. Reference frames are assigned to reference picture buffers when used for encoding and are identified with picture IDs unique relative to other picture IDs currently associated with the reference picture buffers. The maximum picture number used as the picture ID can be based on a number of reference picture buffers available to encode and decode the frames plus a value based on an expected error rate. The picture IDs can be assigned based on a least recently used policy. When a reference frame is no longer needed for encoding and decoding, a picture ID number associated with the reference frame can be released for re-assignment to a new reference frame.

Managing multi-reference picture buffers and identifiers to facilitate video data coding

A method and apparatus for performing object-based intra-prediction encoding and decoding is disclosed. Implementations of object-based intra-prediction encoding and decoding include segmenting a current block into a first portion and at least a second portion; generating, for at least some of a plurality of pixels in the first portion, corresponding predicted values according to at least a first intra-prediction mode; generating, for at least some of a plurality of pixels in the second portion, corresponding predicted values according to at least a second intra-prediction mode; and encoding the current block using the predicted values of the first portion and the predicted values of the second portion.

Adaptive media optimization is described. Aspects of the invention modify video encoding and network transmission settings to optimize the user viewing experience. The system and method sample video content to determine various content features of the video. The system and method use the identified content features in conjunction with network statistics to modify encoding settings and network transmission options to ensure a minimum of interruption in the transmitted video. Previously generated lookup tables ensure efficient mapping of video content and network conditions to encoding and transmission settings.

Growing community of inventors

Campbell, CA, United States of America

Marco Paniconi