Nvidia Corporation

Ati International Srl

Ati Technologies Ulc

Stefan Eckart

Michael L Lightstone

Hassane S Azar

Fabio Ingrao

Xiaohua Yang

Richard W Webb

Dawid Stanislaw Pajak

Swagat Mohapatra

Haitao Guo

Stephen J Orr

Frans Sijstermans

Bryan Dudash

Jincheng Li

Yu Xinyang

Miachel L Lightstone

Yong Peng

Zheng Wei Jiang

A method and apparatus for rate control for a constant-bit-rate finite-buffer-size video encoder is described. Rate control is provided by adjusting the size of non-intra frames based on the size of intra frames. A sliding window approach is implemented to avoid excessive adjustment of non-intra frames located near the end of a group of pictures. A measurement of 'power' based on a sum of absolute values of pixel values is used. The 'power' measurement is used to adjust a global complexity value, which is used to adjust the sizes of frames. The global complexity value responds to scene changes. An embodiment of the invention calculates and uses Ldistances and pixel block complexities to provide rate control. An embodiment of the invention implements a number of bit predictor block. Predictions may be performed at a group-of-pictures level, at a picture level, and at a pixel block level. An embodiment of the invention resets a global complexity parameter when a scene change occurs.

Method and apparatus for rate control for constant-bit-rate-finite-buffer-size video encoder

A system and method are provided for improving video encoding using content information. A three-dimensional (3D) modeling system produces an encoded video stream. The system includes a content engine, a renderer, and a video encoder. The renderer receives 3D model information from the content engine relating and to produces corresponding two-dimensional (2D) images. The video encoder receives the 2D images and produce a corresponding encoded video stream. The video encoder receives content information from the content engine, transforms the content information into encoder control information, and controls the video encoder using the encoder control information.

System and method for improving video encoding using content information

In the claimed approach, a high efficiency video coding codec optimizes the memory resources used during motion vector (MV) prediction. As the codec processes block of pixels, known as coding units (CUs), the codec performs read and write operations on a fixed-sized neighbor union buffer representing the MVs associated with processed CUs. In operation, for each CU, the codec determines the indices at which proximally-located 'neighbor' MVs are stored within the neighbor union buffer. The codec then uses these neighbor MVs to compute new MVs. Subsequently, the codec deterministically updates the neighbor union buffer&#x2014;replacing irrelevant MVs with those new MVs that are useful for computing the MVs of unprocessed CUs. By contrast, many conventional codecs not only redundantly store MVs, but also retain irrelevant MVs. Consequently, the codec reduces memory usage and memory operations compared to conventional codecs, thereby decreasing power consumption and improving codec efficiency.

Memory management of motion vectors in high efficiency video coding motion vector prediction

A video frame compression system includes a rendering engine that provides a current video frame and current additional rendering information. Additionally, the video frame compression system includes a warping engine that generates a warped video frame, wherein the warped video frame is a transformation of a previous video frame that is based on the current additional rendering information. Further, the video frame compression system includes a video encoder that compresses the current video frame by using the warped video frame as a reference frame and separately compresses the current additional rendering information. Still further, the video frame compression system includes a packetizer that provides main and auxiliary data streams corresponding to the compressed current video frame and the compressed current additional rendering information, respectively. A video frame decompression system and methods of video frame compression and decompression are also provided.

Extending prediction modes and performance of video codecs

Method for rate control for constant-bit-rate-finite-buffer-size video encoder

The present invention provides an apparatus for interpolation which is able to process input data with multiple video standards without sacrificing chip area. The interpolation unit comprises: a first interpolation unit for interpolating input data; a second interpolation unit for interpolating input data; a filter indicator for providing information to the first interpolation unit and the second interpolation unit; and an output unit for multiplexing and averaging output from the first interpolation unit and the second interpolation unit. The present invention also provides a motion compensation unit and a decoder for processing multiple video standards.

Two-dimensional interpolation architecture for motion compensation in multiple video standards

An Inverse Hadamard Transform (IHT) converter and system includes a first group of registers for receiving coefficients inputted to the IHT converter; a first adder for adding selected the coefficients stored in the first group of registers; a second group of registers for receiving results from the first adder; and a second adder for adding selected the results stored in the second group of registers.

Inverse Hadamard transform converter and system

A software program includes at least two performance levels. Each performance level has an associated processor utilization. Each performance level corresponds to optimization criteria, such as a quality of data processing performed by the software program. The performance level is selected to maintain processor utilization by the software program within constraints, such as a desired range of processor utilization and a minimum idle thread allocation.

Managing a video encoder to facilitate loading and executing another program

A video encoder includes a programmable rate controller. In one embodiment, the programmable rate controller includes a variable bit rate controller, a constant bit rate controller, and an arbitration logic for selecting one of the two outputs. An embodiment of a variable bit rate controller tracks long-term changes to average bit rate. An embodiment of a constant bit rate controller classifies macroblock types, determines a statistical indicator of complexity for each macroblock type, and generates a target bit rate based on estimated complexity.

Apparatus, system, and method for video encoder rate control

A method and apparatus for rate control for a constant-bit-rate finite-buffer-size video encoder is described. Rate control is provided by adjusting the size of non-intra frames based on the size of intra frames. A sliding window approach is implemented to avoid excessive adjustment of non-intra frames located near the end of a group of pictures. A measurement of 'power' based on a sum of absolute values of pixel values is used. The 'power' measurement is used to adjust a global complexity value, which is used to adjust the sizes of frames. The global complexity value responds to scene changes. An embodiment of the invention calculates and uses L1 distances and pixel block complexities to provide rate control. An embodiment of the invention implements a number of bit predictor block. Predictions may be performed at a group-of-pictures level, at a picture level, and at a pixel block level. An embodiment of the invention resets a global complexity parameter when a scene change occurs.

Method and apparatus for rate control for constant-bit-rate finite-buffer-size video encoder

The invention provide methods and code for better detecting 3:2 pulldown or other video formats. In one respect, embodiments of the invention improve the way in which fields of video data are compared. In another respect, embodiments of the invention provide pattern matching techniques and code for processing the field difference data.

Method for video format detection

A method and apparatus for multiplexing data streams is provided. An earliest time and a latest time are determined for each packet of a each data stream. The packets of the data streams are multiplexed so as to meet earliest time and latest time requirements. The calculation of the earliest time and the latest time are simplified by allowing use of linear constraints rather than irregular stairstep constraints. Compensation for drift in the data streams is also provided.

Method and apparatus for multiplexing data streams using time constraints

A method and apparatus for successive linear approximation to obtain a specific point on a non-linear monotonic function include processing that begins by obtaining a T-coordinate for the specific point. The specific point includes a T-coordinate and an N-coordinate. The process then continues by selecting a minimum point and a maximum point on the non-linear monotonic function to bound the specific point. The processing then continues by deriving a linear reference between the minimum and maximum points. The process then proceeds by obtaining a reference N-coordinate that lies on the linear reference based on the T-coordinate. The process then continues by determining a reference T-coordinate lying on the non-linear monotonic function based on the referenced N-coordinate. The process then continues by determining whether the referenced T-coordinate is substantially similar to the T-coordinate. When the referenced T-coordinate is not substantially similar to the T-coordinate, re-defining the minimum point or the maximum point based on the referenced T-coordinate. The process then repeats until the referenced T-coordinate is substantially similar to the T-coordinate. Once the referenced T-coordinate is substantially similar to the T-coordinate, the referenced N-coordinate is determined to be substantially equal to the N-coordinate such that the specific point.

Method and apparatus for retrieving digital video using successive linear approximation

A method and apparatus for storing multimedia data for use in a digital VCR includes processing that begins by maintaining a first link list of a plurality of memory sections, where the first link list links the plurality of memory sections as a circular buffer. The processing then continues by receiving a stream of multimedia data. The processing then continues by storing the stream of multimedia data in at least some of the memory sections of the plurality of memory sections. The processing then continues by receiving a request for independent storage of a selected portion of the stream of multimedia data, e.g., the user desires to have a permanent copy of a particular program. The processing further continues by generating a second link list for a set of memory sections of the at least some of the memory sections. The set of memory sections stores the selected portion of the stream of multimedia data. The processing continues by updating the linking of the plurality of memory sections within the first link list without the set of memory section.

Method and apparatus for storing multi-media data

A method and apparatus for indexing and locating key frames in streaming frame data and variable-frame-length data is described. Fast and efficient location of desired key frames in both directions (e.g., forward/backward, future/past) is provided. An estimate of the distance to the desired key frame is made and a seek performed according to that distance. At the location specified by the seek, key frame seek assist data are obtained. The desired key frame is located or a new seek is performed, depending on the key frame seek assist data obtained. By placing the key frame seek assist data at readily identifiable locations, efficient location of key frames is provided. The key frame seek assist data may be tailored to optimize efficiency for seeking in a particular direction, for example, backwards. The seek process is correspondingly configured to favor seeking in the more efficient direction.

Growing community of inventors

Mountain View, CA, United States of America

Stefan Eckart