Qualcomm Incorporated

Samuel Benjamin Holmes

Jonathan Wicks

Robert John Vanreenen

Tate Hornbeck

Martin Renschler

Liang Li

Elina Kamenetskaya

Arjun Chopra

Jonathan Scott Tinkham

Aspects presented herein relate to methods and devices for graphics processing including an apparatus, e.g., a graphics processing unit (GPU). The apparatus may obtain a first indication of a first image including a set of first image sections with a plurality of first subsections and a second indication of a second image including a set of second image sections with a plurality of second subsections. The apparatus may also compare one first image section with one second image section. Further, the apparatus may calculate a magnitude of difference between one first subsection and each of the multiple second subsections. The apparatus may also output a third indication of at least one of: (1) a lowest magnitude of difference between the one first subsection and each of the multiple second subsections or (2) a set of coordinates for a second subsection that corresponds to the lowest magnitude of difference.

Block matching window search instruction using a graphics processing unit (GPU) texture pipeline

Systems and techniques are provided for synchronizing a frame rate of pass-through content from a camera and a display refresh rate. An example method can include obtaining first and second frames captured by an image capture device (which may be part of a device, such as an extended reality (XR) device). A display refresh rate of a display is greater than a camera frame rate of the image capture device. The method may determine motion between the first frame and the second frame. The method can include predicting, based on the second frame and the determined motion, a third frame corresponding to a time after the second frame. The method can include displaying content (e.g., mixed reality content) including the predicted third frame and virtual content rendered for the XR device.

Camera frame extrapolation for video pass-through

The present disclosure relates to methods and devices for graphics processing including an apparatus, e.g., a GPU. The apparatus may process at least one frame including frame content associated with a grid including a plurality of grid sections, each of a plurality of portions of the frame content being aligned with at least a portion of at least one of the plurality of grid sections. The apparatus may also shift the frame content with respect to the grid, such that at least one portion of the plurality of portions of the frame content is aligned with at least a portion of at least one distinct grid section of the plurality of grid sections. Additionally, the apparatus may store the shifted frame content including the at least one portion of the frame content that is aligned with at least a portion of the at least one distinct grid section.

Methods and apparatus for content shifting in foveated rendering

The present disclosure relates to methods and devices for image or frame processing including an apparatus, e.g., a GPU. In some aspects, the apparatus may identify a discontinuity between at least one first region of a first frame and at least one second region of a second frame, the at least one first region corresponding to the at least one second region. The apparatus may also determine whether the discontinuity between the at least one first region and the at least one second region is greater than or equal to a motion estimation threshold. The apparatus may also skip a motion estimation for the at least one first region and the at least one second region when the discontinuity between the at least one first region and the at least one second region is greater than or equal to the motion estimation threshold.

Methods and apparatus for motion estimation based on region discontinuity

A frame processor may generate a mask based on one or more static regions of a first set of frames of a plurality of previous frame and adjust the mask to at least one of determine alpha data or conceal distorted content associated with the one or more static regions of the first set of frames. The distorted content may be caused by extrapolation of a frame from a second set of frames of the plurality of previous frames. The frame processor may generate a composite frame based on application of at least one of the mask or the alpha data to a previous frame of the plurality of frames, and application of the previous frame based on the at least one of the mask or the alpha data to the frame extrapolated from the second set of frames of the plurality of previous frames.

High quality UI elements with frame extrapolation

The present disclosure relates to methods and devices for motion estimation which may include a GPU. In one aspect, the GPU may generate at least one first motion vector in a first subset of a frame, the first motion vector providing a first motion estimation for image data in the first subset of the frame. The GPU may also perturb the image data. Also, the GPU may generate at least one second motion vector based on the perturbed image data, the second motion vector providing a second motion estimation for the image data. Moreover, the GPU may compare the first motion vector and the second motion vector. Further, the GPU may determine at least one third motion vector for the motion estimation of the image data based on the comparison between the first motion vector and the second motion vector.

Motion estimation through input perturbation

The present disclosure relates to methods and apparatus for graphics processing. The apparatus can determine a motion estimation priority for one or more regions in a frame. In some aspects, each of the one or more regions can include a group of pixels. Additionally, the apparatus can adjust a quality of a motion estimation procedure for each group of pixels based on the motion estimation priority of the region including the group of pixels. The apparatus can also perform the motion estimation procedure for each of the at least one group of pixels to generate a motion vector for the at least one group of pixels based on the adjusted quality of the motion estimation procedure.

Methods and apparatus for efficient motion estimation

Example techniques are described for generating graphics content by obtaining a rendering command for a frame of the graphics content, obtaining an eye position of a user after obtaining the rendering command, determining a foveation parameter for a region of the graphics content based on the eye position; and rendering a tile, of the frame, corresponding to the region of the graphics content using the foveation parameter and the rendering command.

Foveated rendering of graphics content using a rendering command and subsequently received eye position data

A method, a computer-readable medium, and an apparatus are provided. The apparatus may be configured to receive information indicative of a fovea region. The apparatus may be configured to identify, based on the information indicative of the fovea region, high priority bins and low priority bins. The apparatus may be configured to determine a rendering time allotment for the frame. The apparatus may be configured to determine that the rendering time allotment for the frame will be exceeded, based on an amount of time used to render the high priority bins and the low priority bins. The apparatus may be configured to render, based on the determination that the rendering time allotment for the frame will be exceeded, at least one of the low priority bins at a first quality instead of a second quality.

In-flight adaptive foveated rendering

Example techniques are described for generating graphics content by obtaining a rendering command for a first frame of the graphics content, rendering a full frame based on the rendering command for the first frame, storing the full frame in a buffer, obtaining a rendering command for a second frame of the graphics content, obtaining an eye position of a user, rendering a partial frame based on the rendering command for the second frame and the eye position of the user, obtaining the full frame from the buffer, and outputting the second frame, wherein the second frame is based on the full frame and the partial frame.

Growing community of inventors

Sterling, MA, United States of America

Samuel Benjamin Holmes