Nvidia Corporation

Shanghai Chenzhu Instrument Co., Ltd.

Jianjun Chen

Wei Feng

Xi He

Yongmao Tang

Dong Zhang

Zejun Hu

Manindra Parhy

Yonghai Wu

Ranga Ramanujam Srinivasan

Sangeun Han

Min Xu

Jing Yang

Gang Du

Chunhui Zhang

Chunfeng Yang

Junan Chen

Chun Feng Yang

Xinyang Yu

Hank Fan

Various embodiments include techniques for performing hardware-assisted motion estimation when encoding blocks of a media frame. A video encoder generates motion vector hints for multiple phases of motion estimation at increasingly finer resolutions until the final motion estimation phase at the full resolution of the media frame. The video encoder divides the media frame into a grid of grid blocks, where the grid blocks are smaller than the standard encoding block size of the media frame. At each phase, the video encoder generates one motion vector hint for each grid block at the selected resolution for that phase. For each motion vector hint, the video encoder generates forward prediction hint data based on a reference media frame previous to the current media frame. Further, for each motion vector hint, the video encoder generates backward prediction hint data based on a reference media frame that follows the current media frame.

Hints selection for hardware-based pyramidal motion estimation search

The present application discloses a HART circuit and a method for determining the state of the field interface thereof. The HART circuit includes a control interface, an adjustable power supply module, a first HART module, an isolation module, and a field interface. The first HART module is configured to generate a first control signal when receiving a first inquiry signal from the control interface. The adjustable power supply module is configured to output a first power signal to the control interface and, in response to the first control signal, modulate the first power signal into a first HART signal. The isolation module is configured to isolate a signal from the first terminal of the isolation module and couple the isolated signal to a second terminal of the isolation module. The field interface is connected to the second terminal of the isolation module.

Hart circuit and method for determining the state of a field interface thereof

Disclosed are systems and techniques for efficient real-time codec encoding of video files. In one embodiments, the techniques include receiving one or more intra-prediction modes, each having a corresponding cost; calculating a first cost of a chroma-from-luma intra-prediction mode; calculating a second cost of the chroma-from-luma intra-prediction mode; and calculating a final cost based on the first cost and the second cost. The techniques also include selecting a final intra-prediction mode; generating, based on the selected final intra-prediction mode, a block of predicted pixels that approximates a block of source pixels of an image frame; and encoding a first alpha value in a bitstream.

Chroma-from-luma mode selection for high-performance video encoding

Disclosed are systems and techniques for efficient real-time codec encoding of video files. In one embodiment, the techniques include obtaining a first plurality of motion vectors of a first resolution, generating a second plurality of motion vectors of a second resolution, and calculating a first cost of the motion vector using a first cost function of a first size. The techniques include selecting a subset of motion vectors of the second plurality of motion vectors, calculating a second cost using a second cost function of a second size, and generating a plurality of combined motion vectors based on the subset of motion vectors. The techniques include calculating a third cost using the second cost function of the second size, selecting a final motion vector, and generating, based on the selected final motion vector, a block of predicted pixels that approximates a block of source pixels of an image frame.

Efficient sub-pixel motion vector search for high-performance video encoding

Disclosed are techniques for compressing data of an image using multiple processing cores. The techniques include obtaining, using a first (second, etc.) processing core, a first (second, etc.) plurality of reconstructed blocks approximating source pixels of a first (second, etc.) portion of an image and filtering, using the first processing core, the first plurality of reconstructed blocks. The filtering includes enabling application of one or more filters to a first plurality of regions that include pixels of the first plurality of reconstructed blocks but not pixels of the second plurality of reconstructed blocks. The filtering further includes disabling application of the one or more filters to a second plurality of regions that include pixels of the first plurality of reconstructed blocks and pixels of the second plurality of reconstructed blocks.

Parallel encoding of video frames without filtering dependency

Disclosed are apparatuses, systems, and techniques for real-time codec encoding of video files using hardware-assisted accelerators that utilize a combination of parallel and sequential processing, in which at least a part of intra-frame block prediction is performed with parallel processing.

Hardware codec accelerators for high-performance video encoding

In various examples, optical flow estimate (OFE) quality is improved when employing a hint-based algorithm in multi-level hierarchical motion estimation by using different scan orders at different resolution levels. A scan of an image performed with a scan order may initially leverage OFEs from a previous scan of the image, where the previous scan was performed using a different scan order. The OFEs leveraged from the previous scan are more likely to be of high accuracy until sufficient spatial hints are available to the hint-based algorithm for the scan to reduce the impact of potentially lower quality OFEs resulting from the different scan order of the previous scan.

Enhanced optical flow estimation using a varied scan order

Disclosed are techniques for compressing data of an image. Intermediate pixels may be determined. Each location of the image may be associated with a block of a plurality of blocks of a first size and a block of a plurality of blocks of a second size. For each block of the first size and of the second size, a first cost for a first mode and a second cost for a second mode may be determined in parallel using the intermediate pixels. A final mode and a final block size may be selected for each location of the image using the first cost and the second cost for each of a respective block of the first size and a respective block of the second size associated with a corresponding location. Final pixels may be determined, and a representation of the image may be obtained based on the final pixels.

Parallel processing of video frames during video encoding

A method for using an average motion vector in a motion vector search process. The method includes accessing an input frame for processing and reading average motion vector information from memory. The method further includes performing a motion vector search by using the average motion vector and a plurality of hints, calculating a winner motion vector based on the average motion vector and the plurality of hints, and storing the winner motion vector back into memory to create a new updated average motion vector. The method further includes finishing processing the input frame using the winning motion vector.

Using an average motion vector for a motion search

The present disclosure discloses a video encoder, a video encoding system and a video encoding method. The video encoder comprises a logic control module and an encoding module. Wherein, the logic control module is configured to receive a control command sent from an external controller for encoding a specified portion of each frame of image, and send the control command to the encoding module; and the encoding module is configured to receive the control command from the logic control module, and encode the specified portion of each frame of image according to the control command, so as to cooperate with a plurality of other video encoders to complete encoding each frame of image. By employing the video encoder, video encoding system and video encoding method according to the present disclosure, each frame of image can be accomplished jointly by a plurality of video encoders, thus significantly reducing the encoding time, diminishing the encoding latency, and achieving real-time encoding of high-definition video sources, in particular, video sources with a resolution ratio of 4 k or above.

Growing community of inventors

Shanghai, China

Jianjun Chen