Advanced Micro Devices Corporation

Ati Technologies Ulc

Ati Technologies Inc.

Daniel Wong

Khaled Mammou

Greg Sadowski

Gabor Sines

Lei Zhang

Ihab Amer

Michael L Schmit

Andrew Evan Gruber

Michael Mantor

Jeffrey T Brady

Jeffrey Gongxian Cheng

Paul Chow

Thomas E Ryan

Kenneth Man

Christopher L Spencer

Peter Cao

Geoffrey Park

Catalin Beju

Iouri Kiselev

The present disclosure is directed a system and method for exploiting camera and depth information associated with rendered video frames, such as those rendered by a server operating as part of a cloud gaming service, to more efficiently encode the rendered video frames for transmission over a network. The method and system of the present disclosure can be used in a server operating in a cloud gaming service to improve, for example, the amount of latency, downstream bandwidth, and/or computational processing power associated with playing a video game over its service. The method and system of the present disclosure can be further used in other applications where camera and depth information of a rendered or captured video frame is available.

Exploiting camera depth information for video encoding

Methods, systems, and computer program products are provided for minimizing latency in a implementation where a peripheral device is used as a capture device and a compute device such as a GPU processes the captured data in a computing environment. In embodiments, a peripheral device and GPU are tightly integrated and communicate at a hardware/firmware level. Peripheral device firmware can determine and store compute instructions specifically for the GPU, in a command queue. The compute instructions in the command queue are understood and consumed by firmware of the GPU. The compute instructions include but are not limited to generating low latency visual feedback for presentation to a display screen, and detecting the presence of gestures to be converted to OS messages that can be utilized by any application.

Minimizing latency from peripheral devices to compute engines

A device and method of forming a video frame from a video stream made up of a multiplexed plurality of sub-streams is disclosed. The method includes forming a foreground plane, forming a mask that represents opaque pixels in the foreground plane, and forming an underlying plane from at least one of the sub-streams and extracting a transparency value associated with each pixel in the foreground and underlying planes. Only those pixels in the underlying and foreground planes not covered by the mask, are blended in accordance with their associated transparency value in a buffer. The buffer is populated with opaque pixels from the foreground plane, at pixel locations corresponding to the mask.

Device and method for compositing video planes

A filter includes a conventional filtering block and a protection block. The conventional filtering block receives input values and provides filtered values. The protection block receives filtered values and a group of input values proximate the current input, to ensure that the output is lies within a range computed for the current input. The range is determined by the protection block based on the group of input values proximate the current input. Any algorithm or statistical function may be applied to the group of input values to determine the range. If a filtered value provided by the conventional filtering block is outside the range, then the protection block computes and outputs a value that is within the range. The filter may be used in temporal or spatial filtering of images and video to mitigate artifacts such as motion artifacts and static artifacts.

Protection filter for image and video processing

A secure execution environment for execution of sensitive code and data including a secure asset management unit (SAMU) is described. The SAMU provides a secure execution environment to run sensitive code, for example, code associated with copy protection schemes established for content consumption. The SAMU architecture allows for hardware-based secure boot and memory protection and provides on-demand code execution for code provided by a host processor. The SAMU may boot from an encrypted and signed kernel code, and execute encrypted, signed code. The hardware-based security configuration facilitates preventing vertical or horizontal privilege violations.

Method and apparatus including architecture for protecting sensitive code and data

A secure execution environment for execution of sensitive code and data including a secure asset management unit (SAMU) is described. The SAMU provides a secure execution environment to run multiple instances of separate program code or data code associated with copy protection schemes established for content consumption. The SAMU architecture allows for hardware-based secure boot and memory protection and provides on-demand code execution for multiple instances of separate program code or data provided by a host processor. The SAMU may boot from an encrypted and signed kernel code, and execute encrypted, signed code. The hardware-based security configuration facilitates the prevention of vertical or horizontal privilege violations.

Method and apparatus for including architecture for protecting multi-user sensitive code and data

Disclosed herein is a processing unit configured to process video data, and applications thereof. In an embodiment, the processing unit includes a buffer and an execution unit. The buffer is configured to store a data word, wherein the data word comprises a plurality of bytes of video data. The execution unit is configured to execute a single instruction to (i) shift bytes of video data contained in the data word to align a desired byte of video data and (ii) process the desired byte of the video data to provide processed video data.

Video instruction processing of desired bytes in multi-byte buffers by shifting to matching byte location

A method and apparatus to improve motion prediction in video processing systems is introduced. When a motion prediction cache completes requesting data for a current macroblock and enters an into idle state, data comprising one or more reference frames is speculatively requested, with the hope that the requested data are will be needed in a subsequent macroblock. If the speculative data is needed, then it is consumed. However, if the speculative data is not needed, then the correct data must be requested and a price is paid for an extra memory read bandwidth. In case the speculative data is the correct data for the subsequent macroblock, the effective memory read latency is reduced and the decode performance increases. The video decoder becomes more immune to memory read latency.

Speculative motion prediction cache

The subject matter disclosed herein provides methods and apparatus, including computer program products, for providing intermediate compression or decompression for use with a video decoder and a memory. In one aspect, there is provided a method including receiving information to enable compression of a macroblock. At an intermediate section coupled to a video decoder and a memory, a macroblock may be compressed. The compression of the macroblock may be based on the received information. The compressed macroblock may be provided to memory. Related apparatus, systems, methods, and articles are also described.

Adaptive compression of video reference frames

An efficient method of compositing planes onto a target surface using a computing device with graphics processing capability is disclosed. The method includes partitioning the target surface, on which planes are composited, into partitions. Each one of the partitions contains connected pixels to be formed by compositing an identical subset of the planes to be composited. Each partition is associated with a corresponding subset of the planes. Each partition and its corresponding set of associated planes are then provided to a graphics processor for composition, using exemplary software components including an application programming interface, a library and device driver software. An image is formed on the target surface by compositing each partition. Using the disclosed method, a single pass through stages of the graphics pipeline for the graphics processor is sufficient to composite multiple planes to form an image on the target surface.

Growing community of inventors

Cupertino, CA, United States of America

Daniel Wong