Qualcomm Incorporated

Texas Instruments Corporation

Qualcomm Technologies, Inc.

Ajit Venkat Rao

Vinay Melkote Krishnaprasad

Pawan Kumar Baheti

Ajit Deepak Gupte

Sandeep Kanakapura Lakshmikantha

Sudipto Banerjee

Pushkar Gorur Sheshagiri

Bojan Vrcelj

Mina Ayman Saleh Yanni Makar

Thomas Stockhammer

Prashanth Haridas Hande

Soyeb Noormohammed Nagori

Bibhu P Mohanty

Hetul Sanghvi

Serafin Diaz Spindola

Arun Shankar Kudana

Mahesh Madhukar Mehendale

Qi Xue

Manoj Koul

Chiranjib Choudhuri

Chayan Sharma

Tushit Jain

Peerapol Tinnakornsrisuphap

Mihir Narendra Mody

Gwendolyn Denise Barriac

Ravi Agarwal

Do-Kyoung Kwon

Naveen Srinivasamurthy

Gerhard Reitmayr

Dieter Schmalstieg

Sanjeev Kumar

Abhijeet Bisain

Maksim Krasnyanskiy

Hemanth Acharya

Zhan Ma

Padmapriya Jagannathan

Deepak Khandelwal

Mina Makar

Pankaj Rabha

Arjun Sitaram

Sagar Ravindra Kalbande

Soumyajit Bijankumar Deb

Anand Prabhakar Satpute

Shraman Biswas

Dieter Schmalsteig

Shreyas Hampali Shivakumar

Yogesh Gupta

Conrad A Harrison

Ashish Jain

Systems and techniques are described herein for processing images. The systems and techniques can be implemented by various types of systems, such as by an extended reality (XR) system or device. In some cases, a first processor receives an image of an environment captured by an image sensor, identifies features depicted in the image, and generates descriptors for the features. The first processor sends the descriptors to a second processor, which may be more powerful than the first processor. The second processor receives the descriptors. The second processor associates the plurality of features with a map of the environment based on at least a subset of the plurality of descriptors. For example, the second processor can track at least a subset of the features based on at least a subset of the descriptors and based on feature information from one or more additional images of the environment.

Feature processing in extended reality systems

Methods and systems for providing software applications on a client device with dynamic control over low-latency mode (LLM) operations of the client device. The client device may monitor downlink data packets of a client software application operating on the client device to detect trigger events. The client device may determine operating parameters of the modem based on a detected trigger event and dynamically adjust the low-latency mode of the modem based on the detect trigger event or the determined operating parameters.

Application based dynamic control of modem datapath behavior

Aspects presented herein relate to methods and apparatus for graphics processing. Aspects presented herein can determine at least one split API for a user device and a server. Further, aspects presented herein can establish a communication interface between the user device and the server based on the split API. Additionally, aspects presented herein can communicate between the user device and the server based on the communication interface and the split API. Some aspects presented herein can implement the at least one split API on at least one of the user device or the server. Aspects presented herein can also divide at least one application workload between the user device and the server based on the at least one split API. Moreover, aspects presented herein can encode or decode application information at the user device or the server.

Methods and apparatus for standardized APIs for split rendering

The present disclosure relates to methods and apparatus for graphics processing. In some aspects, the apparatus may receive, by a first device from a second device, first position information corresponding to a first orientation of the second device. The apparatus can also generate, by the first device, first graphical content based on the first position information. Further, the apparatus can also generate, by the first device, motion information for warping the first graphical content. The apparatus can also encode, by the first device, the first graphical content. Additionally, the apparatus can provide, by the first device to the second device, the motion information and the encoded first graphical content.

Asynchronous space warp for remotely rendered VR

A method and a system for warping a rendered frame is disclosed. On a host device of a split-rendering system, the method includes generating the rendered frame based on head tracking information of a user. The method also includes identifying a region of interest (ROI) of the rendered frame. The method also includes generating metadata for a warping operation from the ROI. The method further include transmitting the rendered frame and the metadata for a warping operation of the rendered frame. On a client device of the split-rendering system, the method includes transmitting head tracking information of a user by a client device. The method also includes receiving the rendered frame and metadata. The method further includes warping the rendered frame using the metadata and display pose information. The host device and the client device may be combined into an all-in-one head mounted display.

Asynchronous time and space warp with determination of region of interest

The present disclosure relates to methods and apparatus for graphics processing. The apparatus can determine an eye-buffer including one or more bounding boxes associated with rendered content in a frame. The apparatus can also generate an atlas based on the eye-buffer, the atlas including one or more patches associated with the one or more bounding boxes. Additionally, the apparatus can communicate the atlas including the one or more patches. The apparatus can also calculate an amount of user motion associated with the rendered content in the frame. Further, the apparatus can determine a size of each of the one or more bounding boxes based on the calculated amount of user motion. The apparatus can also determine a size and location of each of the one or more patches in the atlas.

Methods and apparatus for atlas management of augmented reality content

The present disclosure relates to methods and apparatus for computer processing. Aspects of the present disclosure can determine at least one of a quality, latency, or capacity of a communication link for communication between a client device and a server. Aspects of the present disclosure can also determine a computational load for an application computation between the client device and the server. Moreover, aspects of the present disclosure can adjust a computational distribution for the application computation between the client device and the server based on at least one of the computational load for the application computation or the at least one of the quality, latency, or capacity of the communication link. Aspects of the present disclosure can also determine a computational capacity of at least one of the client device or the server.

Methods and apparatus for distribution of application computations

An improved wireless split rendering system for displaying Extended Reality (XR) content is discussed. A rendering server and client head-mounted device (HMD) may communicate over a wireless medium, where communication control is given to a server application layer logic. This allows the server to use request pose information from the HMD only when needed for rendering, while preserving bandwidth on the wireless medium for transmitting frames of the rendered content. This reduces contention and improves channel efficiency.

Cross layer traffic optimization for split XR

A server includes a processor configured to determine, based on reception of information from a client device, synchronization parameters between a server clock rate associated with the server and a client clock rate associated with the client device. The processor is also configured to determine a client-side generation timestamp for an audio frame based on the synchronization parameters and based on a server-side generation timestamp for the audio frame. The processor is further configured to generate the audio frame. The audio frame includes the client-side timestamp.

Audio playback timing adjustment

Techniques are provided for adaptively controlling an encoding device to allow dynamic insertion intra-coded video content based on feedback information. For example, at least a portion of a video slice of a video frame in a video bitstream can be determined to be missing or corrupted. Feedback information indicating at least the portion of the video slice is missing or corrupted can be sent to an encoding device. An updated video bitstream can be received from the encoding device in response to the feedback information. The updated video bitstream can include at least one intra-coded video slice having a size that is larger than the missing or corrupted video slice. The size of the at least one intra-coded video slice can be determined to cover the missing or corrupted slice and propagated error in the video frame caused by the missing or corrupted slice.

Dynamic video insertion based on feedback information

Systems, methods, and computer-readable media are provided for distributed tracking and mapping for extended reality experiences. An example method can include computing, at a device, a pose of the device at a future time, the future time being determined based on a communication latency between the device and a mapping backend system; sending, to the mapping backend system, the pose of the device; receiving, from the mapping backend system, a map slice including map points corresponding to a scene associated with the device, the map slice being generated based on the pose of the device, wherein the map points correspond to the predicted pose; and computing an updated pose of the device based on the map slice.

Distributed pose estimation

Aspects of the present disclosure provide a method for compressing a point cloud. The method includes determining a sub-division technique for the volume based on one or more numbers derived from a distribution of points in the volume, dividing the volume into a number of sub-volumes according to the sub-division technique, and determining whether each sub-volume of the sub-volumes is occupied by at least one point. The method includes generating a bit sequence for the volume comprising a control code that is based on the sub-division technique and an occupancy indicator that indicates whether or not each sub-volume is occupied by at least one point.

Compression of point clouds via a novel hybrid coder

A wearable display device is described that is connected to a host device. The wearable display device includes one or more sensors configured to generate eye pose data indicating a user's field of view, one or more displays, and one or more processors. The one or more processors are configured to output a representation of the eye pose data to the host device and extract one or more depth values for a rendered frame from depth data output by the host device. The rendered frame is generated using the eye pose data. The one or more processors are further configured to modify one or more pixel values of the rendered frame using the one or more depth values to generate a warped rendered frame and output, for display at the one or more displays, the warped rendered frame.

Asynchronous time warp with depth data

Example techniques are described for image processing. Processing circuitry may warp image content of a previous frame based on pose information of a device when the device requested image content information of the previous frame and pose information of the device when the device requested image content information of a current frame to generate warped image content, and blend image content from the warped image content with image content of the current frame to generate an error concealed frame. A display screen may display image content based on the error concealed frame.

Error concealment in virtual reality system

Growing community of inventors

Bengaluru, India

Ajit Venkat Rao