Ati Technologies Ulc

Advanced Micro Devices Corporation

Vixs Systems, Inc.

Huawei Technologies Co., Limited

Yang Liu

Gabor Sines

Ihab Amer

Feng Pan

Edward A Harold

Wei Gao

Haibo Liu

Ying Luo

Crystal Yeong-Pian Sau

Boris Ivanovic

Jinbo Qiu

Lei Zhang

Mingkai Shao

Crystal Sau

Shu-Hsien Wu

Mehdi Saeedi

Ihab M A Amer

Dong Liu

Baochun Li

Kyle Plumadore

Zhiqi Hao

Guennadi Riguer

Zhen Biao Chen

Jiao Wang

Ahmed M Abdelkhalek

Andy Sung

Bingbing Liu

Ho Hin Lau

Ehsan Nezhadarya

Sonu Thomas

Ehsan Mirhadi

Zhong Hai Cai

Stephen Ho

Jingyun Jiao

Thomas D Perry

Mohamed Ibrahim Hafez Ibrahim

Jatinder Singh Bhachu

Kai Sun

Sai Harshita Tupili

A method and system for traversing a bounding volume hierarchy (BVH) structure associated with a given 3D scene using a ray tracing algorithm are provided. The method comprises: determining an escape probability value for a given node of the BVH structure of a given ray traversing the given node without reflecting off any mesh element contained therein; propagating a ray in the given 3D scene that intersects the respective bounding volume of the given node; in response to determining that the ray is to traverse the respective bounding volume, determining whether the ray is to traverse or to reflect off an other respective bounding volume; and in response to determining that the ray is to reflect off the respective bounding volume: rendering a mesh element contained in the respective bounding volume of the given BVH node.

Method and a system for bounding volume hierarchy approximation

An encoder encodes an image portion by recursively partitioning the portion into a partitioning hierarchy of levels. The top level has a single block representing the entire portion and each lower level has four smaller blocks representing a corresponding larger block at a higher level. A palette table is generated for each bottom-level block based on the pixels of the associated block. For each successively higher level, the encoder generates a palette table for each current-level block by selecting palette colors based on the palette colors from the four palette tables for the associated four blocks at the next-lowest level. A color index map is then generated based on a final palette table selected from the palette tables generated for the partitioning hierarchy. A representation of the portion is then encoded using the final palette table and the color index map to generate a corresponding segment of an encoded bitstream.

Palette mode video encoding utilizing hierarchical palette table generation

Systems, apparatuses, and methods for performing parallel histogram calculation with application to palette table derivation are disclosed. An encoder calculates a first histogram for a first portion of pixel component value bits of a block of pixels. Then, the encoder selects a first number of the highest pixel count bins from the first histogram. Also, the encoder calculates a second histogram for a second portion of pixel component value bits of the block. The encoder selects a second number of the highest pixel count bins from the second histogram. A third histogram is calculated from the concatenation of bits assigned to the first and second number of bins, and the highest pixel count bins are selected from the third histogram. A palette table is derived based on these highest pixel count bins selected from the third histogram, and the block of pixels is encoded using the palette table.

Parallel histogram calculation with application to palette table derivation

Systems, apparatuses, and methods for calculating multi-pass histograms for palette table derivation are disclosed. An encoder calculates a first histogram for a first portion of most significant bits (MSBs) of pixel component values of a block of an image or video frame. Then, the encoder selects a given number of the highest pixel count bins from the first histogram. The encoder then increases the granularity of these selected highest pixel count bins by evaluating one or more additional bits from the pixel component values. A second histogram is calculated for the concatenation of the original first portion MSBs from the highest pixel count bins and the one or more additional bits, and the highest pixel count bins are selected from the second histogram. A palette table is derived based on these highest pixel count bins selected from the second histogram, and the block is encoded using the palette table.

Hierarchical histogram calculation with application to palette table derivation

A feedback processing module includes a memory configured to store feedback received from an encoder. The feedback includes parameters associated with encoded graphics content generated by a graphics engine. The feedback processing module also includes a processor configured to generate configuration information for the graphics engine based on the feedback. The graphics engine is configured to execute a workload based on the configuration information. In some cases, the feedback processing module is also configured to receive feedback from a decoder that is used to decode the graphics content that is encoded by the encoder and generate the configuration information based on the feedback received from the decoder.

Graphics rendering with encoder feedback

Reference frame detection using sensor metadata, including: storing a plurality of first frames each corresponding to first metadata, wherein the first metadata for each first frame of the plurality of first frames is based on first sensor data from one or more sensors; generating a second frame corresponding to second metadata based on the one or more sensors; identifying, based on the first metadata of the plurality of first frames and the second metadata, a reference frame of the plurality of first frames; and encoding the second frame based on the reference frame.

Reference frame detection using sensor metadata

A server offloads graphics effects processing to a client device with graphics processing resources by determining a modification to a graphics effects operation, generating a portion of a rendered video stream using the modification to the graphics effects operation, and providing an encoded representation of the portion of the rendered video stream to the client device, along with metadata representing the modification implemented. The client device decodes the encoded representation to recover the portion of the rendered video stream and selectively performs a graphics effects operation on the recovered portion to at least partially revert the resulting graphics effects for the portion to the intended effects without the modification implemented by the server.

Client-side offload of graphics effects processing

An encoding method is provided which includes receiving a plurality of images, obtaining values of elements in a portion of the images, sorting the elements according to different values of the elements, sorting the elements according to a number of occurrences of the different values and encoding the elements using a subset of the different values having corresponding numbers of occurrences that are higher than corresponding numbers of occurrences of other values. Examples also include a processing device and method for use with palette mode encoding in which the elements are a portion of pixels in images and the values are color values of the portion of pixels in the images.

Top palette colors selection using sorting for palette mode in video encoding

Calculating, for each frame of a plurality of frames, a corresponding quality value; calculating, for each frame of the plurality of frames, based on one or more visual attributes of a frame, a weight for the corresponding quality value of the frame; calculating an aggregate quality value for the plurality of frames based on the weight and the corresponding quality value for each frame of the plurality of frames; and providing an assessment of the plurality of frames based on the aggregate quality value for the plurality of frames.

Video quality assessment using aggregated quality values

Methods and apparatus provide cloud-based video encoding that generates encoded video data by one or more encoders in a cloud platform for a plurality of cloud encoding sessions. The methods and apparatus generate operational improvement tradeoff data in response to operational encoding metrics associated with the one or more encoders and change operational characteristics of the one or more encoders for at least one of the cloud encoding sessions based on the operational improvement tradeoff data.

Method and apparatus for providing cloud-based video encoding

Methods and devices are provided for encoding video. By using co-sited gradient and variance values to detect text and line in frames of the video. A processor is configured to receive a plurality of frames of video, determine, for a portion of a frame, a variance of the portion of the frame and a gradient of the portion of the frame and encode, using one of a plurality of different encoding qualities, the portion of the frame based on the gradient and the variance of the portion of the frame. Encoding is performed at both the sub-frame level and frame level. The portion of the frame is classified into one of a plurality of categories based on the gradient and variance and encoded based on the category.

Text and line detection in video encode by using co-sited gradient and variance values

Systems, apparatuses, and methods for generating a model for determining a quantization strength to use when encoding video frames are disclosed. A pre-encoder performs multiple encoding passes using different quantization strengths on a portion or the entirety of one or more pre-processed video frames. The pre-encoder captures the bit-size of the encoded output for each of the multiple encoding passes. Then, based on the multiple encoding passes, the pre-encoder generates a model for mapping bit-size to quantization strength for encoding video frames or portion(s) thereof. When the encoder begins the final encoding pass for one or more given video frames or any portion(s) thereof, the encoder uses the model to map a preferred bit-size to a given quantization strength. The encoder uses the given quantization strength when encoding the given video frame(s) or frame portion(s) to meet a specified bit-rate for the encoded bitstream.

Content adaptive quantization strength and bitrate modeling

A system and method for dynamically changing encode quality at a block level based on runtime pre-encoding analysis of content in a video stream. A video encoder continuously analyzes the content during runtime, and collects statistics and/or characteristics of the content before encoding it. This classifies the block among pre-defined categories of content, where every category has its own compression parameters.

Hierarchical measurement of spatial activity for text/edge detection

Systems, apparatuses, and methods for reducing latency when consuming an encoded video bitstream in real-time are disclosed. A video encoder encodes a video bitstream and writes chunks of the encoded bitstream to a bitstream buffer. Prior to the encoder completing the encoding of an entire frame, or an entire slice of a frame, a consumer module consumes encoded chunks of the bitstream. In one implementation, to enable pipelining of the consumption with the encoding, the encoder updates a buffer write pointer with an indication of the amount of data that has been written to the bitstream buffer. The consumer module retrieves encoded data from the bitstream buffer up to the location indicated by the buffer write pointer. In this way, the consumer module is able to access and consume encoded video data prior to the encoder finishing encoding an entire frame or an entire slice of the frame.

Low-latency consumption of an encoded video bitstream

Growing community of inventors

Toronto, Canada

Yang Liu