Qualcomm Incorporated

Jonathan Wicks

Samuel Benjamin Holmes

Robert John Vanreenen

Tate Hornbeck

Martin Renschler

Andrew Evan Gruber

Chun Wang

Liang Li

Elina Kamenetskaya

Mark Sternberg

Daniel Stan

Kevin Matlage

Jonathan Scott Tinkham

Arjun Chopra

Aspects presented herein relate to methods and devices for graphics processing including an apparatus, e.g., a graphics processing unit (GPU). The apparatus may obtain a first indication of a first image including a set of first image sections with a plurality of first subsections and a second indication of a second image including a set of second image sections with a plurality of second subsections. The apparatus may also compare one first image section with one second image section. Further, the apparatus may calculate a magnitude of difference between one first subsection and each of the multiple second subsections. The apparatus may also output a third indication of at least one of: (1) a lowest magnitude of difference between the one first subsection and each of the multiple second subsections or (2) a set of coordinates for a second subsection that corresponds to the lowest magnitude of difference.

Block matching window search instruction using a graphics processing unit (GPU) texture pipeline

Systems and techniques are provided for synchronizing a frame rate of pass-through content from a camera and a display refresh rate. An example method can include obtaining first and second frames captured by an image capture device (which may be part of a device, such as an extended reality (XR) device). A display refresh rate of a display is greater than a camera frame rate of the image capture device. The method may determine motion between the first frame and the second frame. The method can include predicting, based on the second frame and the determined motion, a third frame corresponding to a time after the second frame. The method can include displaying content (e.g., mixed reality content) including the predicted third frame and virtual content rendered for the XR device.

Camera frame extrapolation for video pass-through

The present disclosure relates to methods and devices for graphics processing including an apparatus, e.g., a GPU. The apparatus may process at least one frame including frame content associated with a grid including a plurality of grid sections, each of a plurality of portions of the frame content being aligned with at least a portion of at least one of the plurality of grid sections. The apparatus may also shift the frame content with respect to the grid, such that at least one portion of the plurality of portions of the frame content is aligned with at least a portion of at least one distinct grid section of the plurality of grid sections. Additionally, the apparatus may store the shifted frame content including the at least one portion of the frame content that is aligned with at least a portion of the at least one distinct grid section.

Methods and apparatus for content shifting in foveated rendering

The present disclosure relates to methods and devices for image or frame processing including an apparatus, e.g., a GPU. In some aspects, the apparatus may identify a discontinuity between at least one first region of a first frame and at least one second region of a second frame, the at least one first region corresponding to the at least one second region. The apparatus may also determine whether the discontinuity between the at least one first region and the at least one second region is greater than or equal to a motion estimation threshold. The apparatus may also skip a motion estimation for the at least one first region and the at least one second region when the discontinuity between the at least one first region and the at least one second region is greater than or equal to the motion estimation threshold.

Methods and apparatus for motion estimation based on region discontinuity

A frame processor may generate a mask based on one or more static regions of a first set of frames of a plurality of previous frame and adjust the mask to at least one of determine alpha data or conceal distorted content associated with the one or more static regions of the first set of frames. The distorted content may be caused by extrapolation of a frame from a second set of frames of the plurality of previous frames. The frame processor may generate a composite frame based on application of at least one of the mask or the alpha data to a previous frame of the plurality of frames, and application of the previous frame based on the at least one of the mask or the alpha data to the frame extrapolated from the second set of frames of the plurality of previous frames.

High quality UI elements with frame extrapolation

The present disclosure relates to methods and devices for motion estimation which may include a GPU. In one aspect, the GPU may generate at least one first motion vector in a first subset of a frame, the first motion vector providing a first motion estimation for image data in the first subset of the frame. The GPU may also perturb the image data. Also, the GPU may generate at least one second motion vector based on the perturbed image data, the second motion vector providing a second motion estimation for the image data. Moreover, the GPU may compare the first motion vector and the second motion vector. Further, the GPU may determine at least one third motion vector for the motion estimation of the image data based on the comparison between the first motion vector and the second motion vector.

Motion estimation through input perturbation

The present disclosure relates to methods and apparatus for graphics processing. The apparatus can determine a motion estimation priority for one or more regions in a frame. In some aspects, each of the one or more regions can include a group of pixels. Additionally, the apparatus can adjust a quality of a motion estimation procedure for each group of pixels based on the motion estimation priority of the region including the group of pixels. The apparatus can also perform the motion estimation procedure for each of the at least one group of pixels to generate a motion vector for the at least one group of pixels based on the adjusted quality of the motion estimation procedure.

Methods and apparatus for efficient motion estimation

Example techniques are described for generating graphics content by obtaining a rendering command for a frame of the graphics content, obtaining an eye position of a user after obtaining the rendering command, determining a foveation parameter for a region of the graphics content based on the eye position; and rendering a tile, of the frame, corresponding to the region of the graphics content using the foveation parameter and the rendering command.

Foveated rendering of graphics content using a rendering command and subsequently received eye position data

Example techniques are described for generating graphics content by obtaining a rendering command for a first frame of the graphics content, rendering a full frame based on the rendering command for the first frame, storing the full frame in a buffer, obtaining a rendering command for a second frame of the graphics content, obtaining an eye position of a user, rendering a partial frame based on the rendering command for the second frame and the eye position of the user, obtaining the full frame from the buffer, and outputting the second frame, wherein the second frame is based on the full frame and the partial frame.

Foveated rendering using variable framerates

Example techniques are described for generating graphics content by assigning a first region of the graphics content to a first tile, assigning a second region of the graphics content to a second tile, determining, at the first tile and at a first resolution, a first set of samples of the graphics content for each pixel of multiple pixels associated with the first region, determining, at the second tile and at a second resolution that is lower than the first resolution, a second set of samples of the graphics content for each pixel of multiple pixels associated with the second region, downsampling the first set of samples into a combined set of samples, preserving samples of the second set of samples to generate a third set of samples with preserved samples, storing the combined set of samples, and storing the third set of samples with preserved samples.

Preserving sample data in foveated rendering of graphics content

The present disclosure relates to methods and devices for display processing. The device can receive a first image including a plurality of first pixels. Each of the first pixels can include a first red, green, blue (RGB) color value. The device can also determine an RGB adjustment value based on a lens correction value. Additionally, the device can determine a second RGB color value for each first pixel based on the determined RGB adjustment value. The device can also generate a second image including a plurality of second pixels, where each of the second pixels includes a determined second RGB color value. Moreover, the device can separate at least one of a red color value, green color value, or blue color value of the RGB color value and adjust at least one of a red color value or a blue color value based on the lens correction value.

Methods and apparatus for inline chromatic aberration correction

This disclosure describes examples for foveated rendering. A graphics processing unit (GPU) may render image content for portions of an image at different sizes such as at sizes smaller than the size of the portions, and store the smaller-sized image content in system memory. The GPU or some other processing circuitry may retrieve the smaller-sized image content from the system memory, and perform resizing operations to resize the image content to its actual size.

Storage for foveated rendering

Techniques are described for generating, with a graphics processing unit (GPU), depth values for pixels of a tile. The tile is one of a plurality of tiles of a frame. The GPU may store a first number of the depth values for the pixels in a tile memory internal to the GPU. The tile memory is configured to store image content for the tile of the frame. The GPU may write a second number of the depth values stored in the tile memory to a system memory. The second number is less than the first number.

Tile-based low-resolution depth storage

A method, an apparatus, and a computer-readable medium for wireless communication are provided. In one aspect, an example method may include storing a first rendered bin corresponding to a frame into a memory. The example method may include storing a second rendered bin including a first over rendered region into the memory. The example method may include blending the first over rendered region with a region of the first rendered bin to generate a blended region in the first rendered bin.

Growing community of inventors

Louisville, CO, United States of America

Jonathan Wicks