Qualcomm Incorporated

Mina Ayman Saleh Yanni Makar

Vijayalakshmi Rajasundaram Raveendran

Hongyu Jiang

Xiaodong Wang

Ajit Venkat Rao

Lochan Verma

Ajit Deepak Gupte

Bibhu P Mohanty

Bojan Vrcelj

Dieter Schmalstieg

Vinay Melkote Krishnaprasad

Qi Xue

Onur Canturk Hamsici

Sandeep Kanakapura Lakshmikantha

Arjun Sitaram

Soumyajit Bijankumar Deb

Na Yu

Anuraag Sridhar

Jesus Manuel Dominguez

Graphics processing in a client device includes receiving, as part of a vector streaming split rendering process, a bit stream encoding a sequence of shading atlases of the process. Each shading atlas includes blocks. The client decodes a particular shading atlas of the sequence of shading atlases, and determines that a particular block of the particular shading atlas was unsuccessfully decoded. The client identifies a stored block of a prior shading atlas of the sequence of shading atlases as a successfully decoded earlier version of the particular block. The client renders the particular shading atlas using the stored block instead of the particular block.

Error concealment in split rendering

In a method and apparatus for processing video data, one or more processors are configured to encode a portion of stored video data in a pixel domain to generate pixel domain video data, a first graphics processing unit is configured to process the video data in a graphics domain to generate graphics domain video data, and an interface transmits the graphics domain video data and the pixel domain video data. One or more processors are configured to parse the video data into a graphics stream and an audio-video stream and decode the video data, a sensor senses movement adaptations of a user, and a second graphics processing unit is configured to generate a canvas on a spherical surface with texture information received from the graphics stream, and render a field of view based on the sensed movement adaptations of the user.

Hybrid graphics and pixel domain architecture for 360 degree video

Techniques are provided for adaptively controlling an encoding device to allow dynamic insertion intra-coded video content based on feedback information. For example, at least a portion of a video slice of a video frame in a video bitstream can be determined to be missing or corrupted. Feedback information indicating at least the portion of the video slice is missing or corrupted can be sent to an encoding device. An updated video bitstream can be received from the encoding device in response to the feedback information. The updated video bitstream can include at least one intra-coded video slice having a size that is larger than the missing or corrupted video slice. The size of the at least one intra-coded video slice can be determined to cover the missing or corrupted slice and propagated error in the video frame caused by the missing or corrupted slice.

Dynamic video insertion based on feedback information

Various aspects of the present disclosure provide for detecting a condition indicating that a graphics processing unit (GPU) is in an unstable state while receiving GPU commands in a first wireless display mode, transmitting a GPU refresh request message and switching from the first wireless display mode to a second wireless display mode in response to detecting the condition, receiving data sufficient to reset the GPU from the unstable state to a stable state at a random access point (RAP) in a trace of the GPU commands, and switching from the second wireless display mode to the first wireless display mode after receiving the data. The GPU refresh request message may include information requesting the data sufficient to reset the GPU at an upcoming RAP in the trace of the GPU commands. Various other aspects are also provided throughout the present disclosure.

Switching a wireless display mode and refreshing a graphics processing unit in an unstable state

An example device for calculating a quality metric for video data includes a memory configured to store a spherical image of the video data, and one or more processors implemented using discrete logic circuitry and configured to determine a user field of view for the spherical image, determine weighting values for pixels of the spherical image based on the user field of view; and calculate a quality metric for the user field of view of the spherical image using the weighting values, wherein calculating the quality metric comprises applying the weighting values to values for the pixels.

Measuring spherical image quality metrics based on user field of view

Aspects of the present disclosure relate to graphics domain transmission methods that utilize an adaptive compression pipeline to achieve low latency screen mirroring between a source device and a sink device. A source device captures a plurality of graphics domain frames, each of the graphics domain frames including one or more graphics command tokens. The source device utilizes an adaptive compression pipeline to compress the graphics domain frames based on one or more characteristics of the frames, and the adaptive compression pipeline is configured to perform at least one of scalable texture streaming, frame-based prediction, frame dropping, or data compression. The source device transmits the compressed frames to a sink device, and displays a rendered image of the graphics domain frames in time synchronization with a corresponding rendered image of the compressed frames displayed at the sink device.

Low latency screen mirroring

In one example, a device for retrieving video data includes a display interface coupled to a display, a memory configured to store video data, and one or more processors configured to determine a plurality of regions of video data to be displayed via the display, retrieve video data having a first quality for a first subset of the plurality of regions at which a visual focus of a user is directed, retrieve video data having a second quality for a second subset of the plurality of regions that neighbor the first subset of the plurality of regions, wherein the second quality is lower than the first quality, and retrieve video data having a third quality for a third subset of the plurality of regions that is outside the first subset and the second subset, wherein the third quality is lower than the second quality.

Independent multi-resolution coding

In one example, a system and method includes acquiring, by a wireless dockee (WD), an image, initiating a wireless connection between the wireless dockee (WD) and a wireless docking center (WDC) having one or more peripherals, determining attributes associated with the acquired image, wherein the attributes include feature descriptors, receiving, at the WD and from the WDC, information representative of matching items stored on one or more of the peripherals, wherein the matching items include images with attributes similar to the attributes associated with the acquired image, selecting, at the WD and as a function of the information representative of the matching items, one or more of the matching items, and receiving, from the one or more of the peripherals, the selected matching items.

System and method for accessing images with a captured query image

In one example, a method for transmitting video data includes capturing a plurality of sets of graphical command tokens respectively renderable into a plurality of frames of video data; and responsive to determining that a length of a current set of graphical command tokens of the plurality of sets of graphical command tokens is the same as a length of a previous set of the plurality of sets of graphical command tokens, outputting, by a source device and to a sink device, a compressed version of the current set of graphical command tokens.

Compression of graphical commands for remote display

In one example, a method for processing video data includes receiving, by a sink device and from a source device, one or more graphical command tokens that are executable to render original video data; modifying, by the sink device, the graphical command tokens to generate modified graphical command tokens that are executable to render modified video data different from the original video data; and outputting, for presentation at a display operatively connected to the sink device, the modified video data.

Modification of graphical command tokens

In one example, a method for transmitting video data includes outputting, by a source device to a sink device, graphical commands and one or more texture elements that are renderable into video data. In this example, outputting a particular texture element of the one or more texture elements includes streaming, by the source device and to the sink device, a plurality of stages that each respectively correspond to a respective subset of pixels of the particular texture element.

Texture element streaming

Source devices are adapted to facilitate video data streaming to a sink device. According to one example, a source device can capture a plurality of frames of video data, each frame including a set of graphical command tokens. Responsive to a delay between the source device and a sink device, the source device can select one or more frames of the plurality of frames to be dropped. The source device may transmit the plurality of frames of video data to a sink device, without transmitting the one or more frames selected to be dropped. Other aspects, embodiments, and features are also included.

Growing community of inventors

San Diego, CA, United States of America

Mina Ayman Saleh Yanni Makar